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Abstract In this paper we consider the use of extended formulations in LP-based algorithms for mixed inte¬ 
ger conic qnadratic programming (MICQP). Extended formnlations have been nsed by Vielma, Ahmed and 
Nemhanser (2008) and Hijazi, Bonami and Ouoron (2013) to construct algorithms for MICQP that can pro¬ 
vide a significant compntational advantage. The first approach is based on an extended or lifted polyhedral 
relaxation of the Lorentz cone by Ben-Tal and Nemirovski (2001) that is extremely economical, but whose 
approximation qnality cannot be iteratively improved. The second is based on a lifted polyhedral relaxation of 
the euclidean ball that can be constrncted using techniques introduced by Tawarmalani and Sahinidis (2005). 
This relaxation is less economical, but its approximation quality can be iteratively improved. Unfortunately, 
while the approach of Vielma, Ahmed and Nemhanser is applicable for general MICQP problems, the approach 
of Hijazi, Bonami and Ouoron can only be used for MICQP problems with convex quadratic constraints. In 
this paper we show how a homogenization procedure can be combined with the technique by Tawarmalani and 
Sahinidis to adapt the extended formulation used by Hijazi, Bonami and Ouorou to a class of conic mixed in¬ 
teger programming problems that include general MICQP problems. We then compare the effectiveness of this 
new extended formulation against traditional and extended formulation-based algorithms for MICQP. We find 
that this new formulation can be used to improve various LP-based algorithms. In particular, the formulation 
provides an easy-to-implement procedure that, in our benchmarks, significantly improved the performance of 
commercial MICQP solvers. 
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1 Introduction 

Most state of the art solvers for (convex) mixed integer nonlinear programming (MINLP) can be classified as 
nonlinear programming (NLP) based branch-and-bound algorithms or linear programming (LP) based branch- 
and-bound algorithms. NLP-based algorithms (e.g. [11,29,36,43]) are the natural extension of LP-based branch- 
and-bound algorithms for mixed integer linear programming (MILP) and solve the NLP relaxation of the 
MINLP in each node of the branch-and-bound tree. In contrast, LP-based algorithms (e.g. [3,9,17,18,23,41, 
46,47]) try to avoid solving the NLP relaxation as much as possible. To achieve this they use a polyhedral 
relaxation of the nonlinear constraints to construct an LP that is solved in the nodes of the branch-and-bound 
tree. The relaxation is iteratively refined through the branch-and-bound procedure, which is combined with 
sporadic solutions to the NLP relaxation. 

Traditional LP-based algorithms construct the polyhedral relaxations in the original variable space used 
to describe the nonlinear constraints. However, an emerging trend is to use auxiliary variables to construct 
extended or lifted polyhedral relaxations of the nonlinear constraints. This approach exploits the fact that the 
projection of a polyhedron can have significantly more inequalities than the original polyhedron. Hence, it is 
sometimes possible to construct small lifted polyhedral relaxations with the same approximation quality as 
significantly larger relaxations in the original space. Two algorithms that use lifted polyhedral relaxations to 
solve quadratic MINLP problems are the lifted LP branch-and-bound (LiftedLP) algorithm developed in [45] and 
the variant of BONMIN introduced in [32]. The two main differences between these approaches are the class 
of lifted polyhedral approximation used and the range of problems to which they are applicable. The LiftedLP 
algorithm from [45] uses a lifted polyhedral relaxation of the Lorentz (or second order) cone introduced by Ben- 
Tal and Nemirovski [5] and hence is applicable to any mixed integer conic quadratic programming (MICQP) 
problem. This relaxation can be tailored to any approximation quality, but once this approximation is fixed the 
relaxation cannot be easily refined. More specifically, the only known way to improve the approximation quality 
is to reconstruct the relaxation from scratch. In this paper we refer to approximations with this property as static 
lifted polyhedral relaxations. The inability to easily refine a static relaxation is clearly undesirable. However, the 
number of constraints and additional variables in the approximation by Ben-Tal and Nemirovski grows so slowly 
that the LiftedLP algorithm is able to use a fixed relaxation throughout its execution. While the approximation 
quality has to be selected a priori, this choice is often a minor calibration exercise and the resulting algorithm 
can significantly outperform traditional LP and NLP-based algorithms. Still, if the approximation quality is 
chosen poorly, the only way to adjust it is to reconstruct the relaxation and restart the algorithm. One potential 
solution to this issue is the variant of BONMIN from [32]. This algorithm uses a lifted polyhedral relaxation of 
the euclidean ball that can be constructed using techniques introduced by Tawarmalani and Sahinidis [44] . This 
approximation is not as efficient as the one by Ben-Tal and Nemirovski, but it is straightforward to iteratively 
refine it to improve the approximation accuracy. In this paper we refer to approximations with this property as 
dynamic lifted polyhedral relaxations. Using this approximation can also significantly improve the performance of 
traditional LP-based algorithms. However, the approach is only applicable for MINLP problems with convex 
quadratic constraints and hence cannot be used for all problems for which the LiftedLP algorithm is applicable. 

In this paper we study the effectiveness of dynamic lifted polyhedral relaxations for the solution of general 
MICQP problems. In particular, we introduce three dynamic lifted polyhedral relaxations of the Lorentz cone. 
The first relaxation is a straightforward adaptation of a portion of the original static relaxation introduced 
by Ben-Tal and Nemirovski [5]. The second relaxation we construct by combining a homogenization procedure 
with the relaxation technique by Tawarmalani and Sahinidis [44]. This yields a relaxation for various conic 
sets including the Lorentz cone. The final relaxation is a simple combination of the previous two. All three 
approximations can be used to improve the LiftedLP algorithm from [45] . However, we show that they can also 
be used directly by interpreting them as lifted conic quadratic formulations of the Lorentz cone, which lead 
to extended MICQP re-formulations of any MICQP problem. We computationally evaluate the effectiveness 
of all three formulations when used by themselves and as an improvement of the LiftedLP algorithm. Our 
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computational results show that the extended MICQP re-formulation version of the homogenized variant of 
the Tawarmalani and Sahinidis relaxation can provide a signihcant computational advantage over traditional 
LP and NLP algorithms and other lifted polyhedral relaxation approaches. 

The remainder of this paper is organized as follows. Section 2 provides a brief introduction to LP-based 
algorithms for MINLP, a detailed description of existing lifted polyhedral relaxations and a brief description 
of their use in LP-based algorithms. This section also compares and contrasts the advantages of extremely 
economical static lifted polyhedral relaxations that cannot be iteratively refined, to less economical dynamic 
relaxations that can be refined. In particular, the section introduces the relaxation from [32,44] as an extremely 
effective compromise between these objectives, that nonetheless has some modeling limitations. Then, Section 3 
shows how the modeling limitations of the relaxation from [32,44] can be eliminated through a homogenization 
procedure that adapts it to all MICQP problems. In this section we also discuss the relation of the homog¬ 
enization procedure with existing perspective reformulation techniques. The new lifted polyhedral relaxation 
leads to some variants of the LiftedLP algorithm from [45], which are described in detail in Section 4. This 
section also shows how the relaxations can be used directly by interpreting them as extended MICQP reformu¬ 
lations. Section 5 then provides a computational comparison of these algorithms and traditional LP-based and 
NLP-based algorithms. Finally, Section 6 discusses some possible improvements for specihc classes of problems 
and some open questions concerning the best possible approximation quality for dynamic lifted polyhedral 
approximations. Omitted proofs and additional hgures and tables are provided in Appendices A and B. 

To improve readability we use the convention of naming polyhedral sets in a natural original variable space 
with upper case letters (e.g. P) and non-polyhedral sets in the same space with bold upper case letters (e.g. 
C). Lifted sets defined in the space of original and auxiliary variables additionally appear with a “hat” (e.g. 
P for lifted polyhedral sets and C for lifted non-polyhedral sets). Additional definitions and notation will be 
introduced as they are needed through the paper. 


2 LP Based Algorithms and Lifted Polyhedral Relaxations 

We consider a MICQP of the form 


obJMiCQP :=max cx (la) 

s.t. 

Ex < h, (lb) 

II -|- b* I <a-x + bQ, VI G {1,..., g} , (Ic) 

II II 2 

X G R”, (Id) 

Xj G Z", Vj G I, (le) 


where c G R", E G R*”^", h G R™, ||•||2 is the euclidean norm, a* • x is the inner product between a* and b, 
and where for each I G {1,..., g} there exist d; such that A* G R'^' 6* G R'^' , G R" and 6q G R. We denote 

problem (1) as MICQP. 

We start by noting that constraint (Ic) can be written as 

A'-x + b'‘=y, a-x + bo=yo, {yo,y)eL‘^\ 

where L'^ is the (d -|- 1)-dimensional Lorentz cone given by L'^ := |(i/o,2/) C : llj/jjj < yo|- Hence, to get 

an LP-based algorithm for (1) it suffices to construct a polyhedral relaxation of L"^. 
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We can construct a polyhedral relaxation of L'^ through its semi-infinite representation given by 

( d \ 


= < (j/o,J/) e ^ J/o.Vcj G S 

I i=i 


d-l 


where ^ < oj G 


^ := |aj G : ||t<j||2 = l| is the unit sphere. Then for any C 8 “^ ^ with \n\ < oo, the set 


Oyt?) :=pyo,?/)e 


pd+l 


: < t/o,Vaj G i 7 

J=i 


( 2 ) 


is a polyhedron such that C This polyhedral relaxation can easily be refined by noting that if 

{yo,y) e {n) \ L‘^ then J2j=i‘^jiy)yj > yo where Uj{y) = -||^ G and hence {yo,y) i 0‘^ {il U {Lj{y)}). 

Polyhedral relaxations such as 0‘^, which do not use auxiliary variables and can be iteratively refined, lead 
to traditional LP-based algorithms usually known as outer approximation algorithms. The simplest version of 
such algorithms is the MILP-based algorithm by Duran and Grossmann [17]. In the context of MICQP, this 
algorithm is based on the MILP relaxation of MICQP given by 




:= max 
s.t. 


: cx 



(3a) 

Ex < h, 



(3b) 

a’‘x - 1 - 6 * = y , 

WG {1,.. 

■ ,y}, 

(3c) 

i , ,i i 

a ■x + bo=yo, 

WG {1,.. 


(3d) 

(yo,y‘) e o‘^‘ , 

WG {1,.. 


(3e) 

X G R”, 



(3f) 

Xj G Z”, 

Vj G I. 


(3g) 


We denote this relaxation by MILP j. 

basic versior 
1 , where for 


A basic version of the MILP-based outer approximation algorithm for solving MICQP is given in Algo- 

r -li 9 

rithm 1, where for simplicity we have assumed the existence of an initial approximating set 




for which 


MILP 


is bounded. 

Algorithm 1 converges in finite time for pure integer problems (p = 0) with bounded feasible regions and 
simple modifications can ensure convergence for the mixed integer case too (e.g. see [9,17,18]). However, the 
following example from [32] shows that an exponential number of iterations may be needed even for very simple 
pure integer problems. 

Example 1 Let F" := |2; G R" : “ 2)^ — consider the description of F” as the feasible 

region of MICQP given by 

Xj - ^ = y^, Vj G {1,...,n} , (4a) 


n — 1 


= yo, 


(yo,y)eL". 


(4b) 

(4c) 
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Algorithm 1 : A Basic LP Based Algorithm. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 
17 


Set for all I G {1,..., g}. 

Solve MILP 

if MILP is infeasible then 

I Declare MICQP infeasible, 
else 

I Let (s, y, { (^Q, be an optimal solution to MILP 

end 

if (^Q,G for all I G {1, ■ ■ ■ ,q} then 
I Return {x,y) as the optimal solution to MICQP. 
else 

] for / = 1 to g do 

if ^ then 

I Set U {Lo{y^)}. 

end 

end 

end 

Go to 2 


It is shown in [32] that if P C is a polyhedron such that C P and PPiZ’^ = 0, then P must have at least 
2^ facets. In particular, {[x^yo^y) G : (4a)-(4b), (yo^y) C 0^(J7)} 7 ^ 0 for any J7 C such that 

|i7| < 2^ and hence Algorithm 1 will require an exponential number of iterations to prove that Pi = 0. 

We can check that := |x G \^j ~ h \ — | such that F^ C P^ and P^ n Z” = 0. 

As expected P^ has an exponential number of facets, but using standard LP techniques we can construct the 

Vj G n}, 

Vj G { 1 ,... ,n} , 

T 


Then, this formulation is a lifted polyhedral relaxation of P” with a linear number of constraints and additional 
variables that can be used to prove F^nZ^ = 0. Hence, the exponential behavior from Example 1 can be avoided 
by using auxiliary variables. In the following subsection we describe two lifted polyhedral relaxation approaches 
that can be used to prove F^ D Z^ = 0 and are also applicable to more general MICQPs. 


lifted LP representation of P^ given by 


Xj- 7^< 


2 5 


j=i 


y/n\/n — 


2.1 Lifted Polyhedral Relaxations 

We begin with a formal dehnition of a lifted polyhedral relaxation of L'^ (the definition naturally generalizes 
to arbitrary convex sets). 

Definition 1 A polyhedron P := i^{yo,y,z) G : A +Dz<b^ for A e ]R™ix(d+i), d e ]R™ix™2 

and b G R"*! is a lifted polyhedral relaxation of if and only if 

L''cProj(,„,,) (P), 
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where is the orthogonal projection onto the {yo,y) variables. 

Two desirable properties of a lifted polyhedral relaxation are small number of inequalities {mi) and number of 
auxiliary variables {m 2 ), and high approximation quality (quantihed through various measures). For instance, 
the first approximation we consider additionally satisfies 


C 


P^'oJtoo,!/) (-P) ^ {(.yo^y) 


yd+l . 


< 


(1 + e)yo|: 


(5) 


which we refer to as having approximation quality e, and mi, m 2 < tp {d, In (1/e)) for a low degree polynomial 
ip. This approximation was introduced by Ben-Tal and Nemirovski [5] (see also [24]) and its construction begins 
by building the lifted polyhedral relaxation of given in the following proposition. 


Proposition 1 Let 


Nf ■= 


{yo,yi,y 2 ,v) e 1R+ x x 


yo = V 2 S -1 cos + V 2 s sin 

Vi = yi cos (tt) + y 2 sin (tt) , 

V2 > \y2 cos (tt) - yi sin (tt)] , 

^; 2 (^+l)-l = ’>’21-1 COS j + V2i sin , 


«2(i+i) > |w2i COS j - V2i-1 sin j I , Vi £ {1,..., s - 1} _ 

Then, Ng is a lifted polyhedral relaxation oflj^ with approximation quality e = cos (^) ^ — 1. 

To construct a lifted polyhedral relaxation of for d > 2, Ben-Tal and Nemirovski observe that 


L'" = 


{yo,y) e 




: 3t £ 


> Ld/2J 


S.t. 


rd/21 

£ 4 < yl 

k=l 

vl/c-i + vife < Vfc £ {1,..., [ci/2J} , 
^\d/ 2 -] = yd, if d is odd 


Recursively repeating this construction for the [d/2] -|- 1 dimensional Lorentz cone inside this representation 
we can construct a version with additional variables that only uses d — 1 three dimensional Lorentz cones. This 
construction was denoted the tower of variables by Ben-Tal and Nemirovski and yields the lifted representation 

(t'^) for 


= 


= {yo 


^^^^,)£Rd.r™^ (^^-,4-r,4).L 


yo 

II 





= Vi, 

Vi £ 

{!.• 

..,d}. 

4) 


Vi £ 

{!,• 




k £ 

{0,. 


tr. 


Vfc £ 

{0,. 




S.t 

• rk 

is odd 


( 6 ) 


where K = [log 2 (d)], {rfe}|Lg is defined by the recursion ro = d, rfc_|_i = [r^./2] for k £ {0, ...,A' — 1} and 
R{d) = A lifted polyhedral relaxation of can then be constructed by replacing every occurrence 

of in with an appropriate polyhedral relaxation. The original approximation of Ben-Tal and Nemirovski 
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uses Ng as a lifted polyhedral relaxation of and leads to essentially the smallest possible approximation of 
(see Section 3 of [5]). However, we will see that using alternative approximations could lead to a computational 
advantage in our context, so the following proposition first presents a generic version of the approximation and 
then specializes it to the original Ben-Tal and Nemirovski approximation. 

Proposition 2 Let K = [log 2 (d)], {ri~}^—Q be defined by the recursion ro = d, for k £ {0,..., K—Y\ 

andR{d) = Ef=o^fc- LetD := : i G {1,..., Lrfc/2J}, k € {0,..., K - 1}} C Z+, G{D) := d^,k 

and V := : * C {1, • • •, k £ {0,..., df — I}} be a family of polyhedra such that, for each i and k, 

Pi,k ^ is a (lifted) polyhedral relaxation o/L^ with approximation quality £ (0,1]. Then 


yo = ti , 

= Vi, Vi £ {1,... ,d}, 

£ xI^'^+l+-R('^)+G(£>) . ^ H2 i-li ^2i> W ’ ) ^ Pi,k! Vi £ {1, . . . , [r/;/2j}, 

Vfc£{0,...,i^-1} 
s.t. r},, is odd 

is a lifted polyhedral relaxation ofU^ with approximation quality e = ^ “ 1- dn particular, let Lg : = 

f'^{Ns,D 2 s) whereNs ■= {iV| : i £ {1 ,..., Lrfc/2J}, k £ {0,..., if - l}|i and 

D2s :={2 s : i £ {1,..., Lrfe/2J}, fc £ {0,..., if - 1 }} . 

Then, for any e £ (0,1) there exists an s (e) £ Z+ such that has O (din (if/e)) variables and constraints, and 

is a lifted polyhedral relaxation of with approximation quality e. 

It is not hard to see that for an appropriately chosen e, iis(e) is a lifted polyhedral relaxation with a polyno¬ 
mial number of variables and constraints that can prove F” n Z" = 0. However, this can also be achieved with 
the tower of variables construction without the use of Ng. To show that we will use the following straightforward 
corollary of Proposition 2, which approximates each in T'^ with non-lifted approximation 0‘^ (17) introduced 
in (2). 


T’^{V,D) ■= 


{yo,y,t,v) 


Corollary 1 Let Q := {l7i_fc ■ * C {1,..., L^fe/2J}, k £ {0 ,..., K — I}} be such that 17, ^, C and |l7i < oo 
for all i, k. For any such, 17 define T'^ (17) := T‘^ (C, Dq) for 

O := {O^ (I7,_fe) : i £ {1,..., Lrfe/2J}, fc e {0,...,df - 1}} 

and Do :={0 : i£{l,..., Lrj,/2J }, k £ {0,...,df — 1}}. Then T‘^ (17), is a lifted polyhedral relaxation of with 


K-l Ltfe/2j 

E E < (d — 1) ^max^ 

fc =0 1=1 

constraints and d — 2 auxiliary variables^. 

^ Or more precisely, J\f := {Ni ^ • i £ {1? ■ • • ? L^fe/2j}, k G {0 ,..., K — 1}} where for each i, k 

^ After removing redundant variables through the equalities of the formulation. 
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The following example shows how the tower of variables approximation based on both and [Q) result 
in small lifted polyhedral approximations that prove F" n Z" = 0. 

Example 2 Let f2o,o = { then we can check that 

P™j(yo.y) (^s) = {^o,o) = {(yo,y) € R+ X : |j/i| + |i/2| < V2i/o| • 

Then, if we let Q := {f2o,o : i G {1,..., [tfc/2J}, A: G {0,..., A" — 1}} then 

(L^)=Proj(,„,,) {f\n)). 

We can also check that 

r f \ i 1 / 2 \ 

minjyo : {vo,y) £ (ia)} = 2 

for all y G {0,1}'^. Hence 

|(a;,2/,yo) e ■. Xj-^= yj Vj G {!,. ..,n} , = yo, {yo,y) G Proj(y^ (P)| nZ” = 0 (7) 

for P = L 2 01 P = T'^ (1?) and both of these formulations can be used to prove F” nZ” = 0. Formulation (17) 
achieves this with 4n — 4 constraints and n — 2 auxiliary variables and L 2 achieves it with 4n — 4 constraints 
and 2 n — 1 auxiliary variables. 

From Examples 1 and 2 we have that the number of constraints in the projection onto the {yo,y) variables 
of both T'^ (17) and Lg can have a number of facets that is exponential on their original number of variables 
and constraints. Hence, both formulations can provide a significant advantage over the traditional outer ap¬ 
proximation formulation 0‘^(12). However, the full potential of the approximation by Ben-Tal and Nemirovski 
approximation is only achieved when Ng is used (e.g. as in Lg). For instance, if d = 2, Lg reduces to Ng, which 
has a linear (in s) number of variables and constraints and which has a projection onto the {yo,y) variables 
with an exponential number of constraints^. In contrast, for d = 2, T‘^ {Q) reduces to 0‘^{n) and hence we 
do not get any constraint multiplying effect through projections. Nonetheless, T'^ (17) does have one advantage 
over Lg. While T‘^ (17) can be iteratively refined by simply augmenting 17, the only way to rehne Lg is to rehne 
each (or some) of the approximations Ng used in its construction. Regrettably, the complexity of Ng does not 
easily lend itself to an iterative refinement and the only known way to refine Ng is to replace it with N'^, for 
s' > s constructed from scratch. Fortunately, there is an alternative lifted approximation that provides a middle 
ground between T'^ (17) and Lf. This approximation can be constructed using the following proposition from 
[44]. 

Proposition 3 Let /^ : R —>■ R 6 e strictly convex differentiable functions for each j G {!,...,n} and let P := 
{Pj ; j G {1,... ,n}} be such that Pj C R and |T)| < 00 . If G := |( 3 / 0 )?/) £ R"~*"^ : fjiVj) — J/o I, then 

/f ( 7 ) +/i ( 7 ) (yj - 7 ) < Wj, yyePj, jG {!,..., n}, ( 8 a) 

n 

“7 - y° 

7=1 

is a lifted polyhedral relaxation of G with 1 -|- \^j \ constraints and whose projection onto the {yo,y) variables 

can have up to 11^=1 \^j\ constraints. 

® For instance, one can check that G ; Proj^j^ (^0 | is a regular 2® polygon. 
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While set G in Proposition 8 has a somewhat restrictive structure, [32] uses it to constructs the following linear 
sized polyhedral approximation that is able to prove F" n Z" =0. 

Example 3 An alternative extended formulation of set F” from Example f is given by 


Xj-]^=yj, Vj e n}, 



E 2 / 2 

Vj < Vo- 


j=i 


(9a) 

(9b) 

(9c) 


Constraint (9c) is not convex, but because yo is fixed to a constant, without loss of generality, we can replace 
(9b) by yo = ^ and (9c) by YTj=i Vj < Vo- Applying Proposition 3 for fj{yj) = y] and Ej = {-1/2,1/2} for 
all j € (1,... ,n} yields the polyhedral relaxation of (9), given by 


1 

Xj — 2 — Vj : 

V/G{1,. 

..,n}, 

(10a) 

y3-\< Wj: 

v/e{i,. 

,.,n}, 

(10b) 

-Vj 

v/e{i,. 

,.,n} , 

(10c) 

^ 1 
n — 1 

4 • 



(lOd) 


j=i 

We can then check that •[(x,y, w) £ : (10), x £ Z"} = 0. 

Formulation (8) shares with T‘^ (17) the possibility of being iteratively refined. Furthermore, while it does 
not reach the efficiency of if, it does provide a tangible improvement over T‘^ (17). For instance for d = 2 (8) 
with ri + r 2 + 1 constraints projects to a polyhedron with at most ri x r 2 constraints. Hence (8) can have an 
up to quadratic constraint multiplying effect (cf. the exponential constraint multiplying effect of Lg and the 
lack of constraint multiplying effect of (17)). However, while formulation (8) yields a polyhedral relaxation of 
F", llyllj cannot be written as a sum of univariate functions and hence formulation (8) cannot be used directly 
to construct a polyhedral relaxation of L‘^. Fortunately, as we will show in the following section, a simple 
homogenization technique can be used to adapt (8) to yield lifted polyhedral relaxations of L'^ and other conic 
sets. These lifted polyhedral relaxations share with (8) the possibility of being iteratively refined. To simplify 
exposition, from now on we refer to relaxations that can be iteratively refined as dynamic relaxations and to 
those that cannot be easily refined as static relaxations. 


3 Dynamic Lifted Polyhedral Relaxations of Conic Sets 

Proposition 3 cannot be directly used to construct a polyhedral relaxation of L'^, but it can be used to construct 
relaxations of the euclidean ball 6“^ := |y G < l| = |y ^ ■ (li v) ^ L‘^|. Furthermore, can 

be constructed from through the homogenization = cone ^{1} Hence, any relaxation of B^ can 

be transformed to a relaxation of through a similar homogenization. This approach can be formally stated 
through the following proposition, which we prove in Appendix A (see Section 6 for an alternative derivation). 
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Proposition 4 Let fj : R —> R 6e closed convex functions such that lima;_>.oo = °o for all j G {1 ,... ,d} so 
that the closure of the perspective function of f is given by 


[elf) {t,x) 


tf{x/t) t > 0 
0 a; = 0 and t = 0 ■ 

oo o.w. 


UC := |i/ G R'^ : Y.'j=i fjiVj) < l} 


C 


{yo,y,w) G 


p2d+l 


1 

{dfj) iyo,yj) <Wj, Vj G 4} , '^Wj<yo>: 

1=1 J 


( 11 ) 


then cone ({1} x C) = Proj(j^^ y) . 

Furthermore, if functions fj are differentiable, then for any F := {/j : j G {1,... ,n}} such that Fj C R and 
j/j I < oo, the set 


d{F) : = 


‘ {yo,y,w) G : 


(/ ( 7 ) - 7 / ( 7 )) yo + / ( 7 ) Vj < wj, 

n 

^3 < yo 
1=1 


V7 G Fj, j G n}' 

> 


is a lifted polyhedral relaxation o/cone({l} x C) with 1 + |li| constraints. If the functions are additionally 

strictly convex the projection onto the variables (j/o,2/) of this relaxation can have up to 11^=1 |l~i| constraints. 

Finally, if {yo,y, w) £ C (F) \ C, then there exists j G {1,..., n} and 7 G R such that {yo,y, w) ^ C {F) if we 
augment Fj to Fj U {7}. 

Obtaining a dynamic lifted polyhedral relaxation for is a direct corollary of Proposition 4 by letting 
fj{xj) = x'j and using = cone ^{1} x ( See [6, p. 109] for an alternative derivation). One notable 

difference between the general approximation from Proposition 4 and the approximation of from Corollary 2 
below is the inclusion of constraint i/o > 0 in the later. This constraint is excluded in Proposition 4, but is 
implied by the nonlinear constraints defining C and can be arbitrarily approximated by the linear constraints of 
C (F) by appropriately selecting F (e.g. see the proof of Lemma 2 in Appendix A). The constraint is explicitly 
included in Corollary 2 to ensure conic quadratic representability of 11“^ and for computational convenience and 
numerical stability in H'^ (F). 

Corollary 2 Let 


:= G < Wjf/o, Vj G {1,..., d} , < yo, 


0 < yo 


( 12 ) 


then L'^ = Proj(y^_y) and hence is a lifted reformulation of with d rotated two-dimensional conic 

guadratic constraints, one linear constraint'^ and d auxiliary variables. 


Note that the complete description of each rotated two-dimensional conic quadratic constraints is y? < wjyo and 0 < yo- 
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Furthermore, for any _r := {/j : j G { 1 ,..., n}} for Fj C R with |/j | < oo, the set 




< Wj, Vj G d}, 7 e Tj,' 

d 

“ (t/o,y,w) e : '^Wj<yo, 

i=i 

0 < t/o- 


is a lifted polyhedral relaxation of'L‘^. 

Finally, if {yo,y,w) G H‘^{F)\& and yo ^ 0 , then there exists j G { 1 ,..., d} such that {yo,y, w) (f F[‘^ [F) if 
we augment Fj to Fj U {7(1/0, yj )} where ') {yo,yj) ■= yj/yo- Similarly if {yo,y, w) G 1 /^ (r) \ H'^ and yo = 0, then 
{yo, y, w) ^ (F) if we augment Fj for all j £ {1,... ,d} to Fj U {—7,7} for any 7 > 0 . 

With a slight abuse of terminology, we refer to F[‘^ {F) as the separable relaxation to emphasize the fact 
that it considers nonlinearities one variable at a time in a similar way to Proposition 3. 


3.1 Relation to Perspective Reformulations 


Perspective functions have been used to model unions of convex sets [12,25,43] for many years, with a recent 
emphasis on modeling of the union of a point and a single convex set [19,21,22,26,27,28,31]. We now show 
how these techniques can be adapted to give an alternative construction of the lifted separable reformulation 

C. 

The alternate construction of C is based on the lifted reformulation of C := |i/ G : Y^j=i fj{yj) < l| 
given by 

C +,1 ■■= i^{y,yo,w) : fj{yj) <Wj, Vj G { 1 ,..., d} , ^iCj<i/o, yo = 1 


and the set C+^o := |(i/,i/o, w) C : yo = yi = Wi = 0, Vi G {1,... ,d}|. Using known results (e.g. Section 

3 of [27] ) we have that, under the assumptions of Proposition 4, 


conv (C+,1 U C+^o) 


{clfj) {yo,yj) < Wj, Vj G {l,...,d}, ' 

d 

“ (y,yo, w) G : '^Wj<yo, 

j=i 

0 < yo < 1 


(13) 


We can also check that cone ({1} x C) = Proj(-j,jj (cone (conv (C+4 U C+,o))) and that cone (conv (C+^i U C+,o)) 
is obtained by removing yo < 1 from the right hand side of (13), from which we precisely obtain C®. Finally, 
inequalities (/ (7) — 'yf (7)) yo + f (7) y < Wj from the polyhedral approximation of C can be obtained from 
the perspective cuts from [19]. 

® Remember that, while C does not explicitly include yo > 0, any point in C satisfies this constraint under the assumptions 
of Proposition 4 (e.g. see proof of Lemma 2 in Appendix A). 
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4 Lifted LP-Based Algorithms 

We can construct lifted LP-based algorithms for MICQP by combining lifted polyhedral relaxations of with 
the general algorithmic framework of traditional LP-based branch-and-bound algorithms [3,9,10,18,41]. For 
static relaxations such as , [45] introduces the LiftedLP algorithm, which uses branching and the sporadic 
solutions of nonlinear relaxations to avoid the need to refine the polyhedral relaxation. Similarly, for dynamic 
polyhedral relaxations such as (F) we can follow the approach of [32] and adapt a traditional LP-based 
branch-and-bound algorithm to construct and refine the polyhedral relaxation on the space of original and 
auxiliary variables. However, for the polyhedral relaxations that are based on a nonlinear reformulation of L'^, 
such as defined in (6), we can more easily adapt a traditional LP-based algorithm by simply giving it this 
reformulation. We now describe how to do this for three relaxations. We then describe two versions of the 
LiftedLP algorithm [45] that we test in Section 5. 


4.1 Algorithms from Nonlinear Reformulations 


The first two relaxations we consider correspond to the tower of variables reformulation T'^ and the separable 
reformulation from Corollary 2. The third one is a combination of these two relaxations. For all three 
relaxations we give to the LP-based branch-and-bound algorithm a reformulation of MICQP of the form 





(14a) 

S.t. 




Ex < h, 



(14b) 

A^x -P 6* = y\ 

WG {1,.. 


(14c) 

i , ,i i 

a .x + bo=yo, 

WG {1,., 


(14d) 

(yo,y^,z^ c Q^'', 

WG {1,., 


(14e) 

a: G R", 



(14f) 

Xj G Z”, 

Vj e I, 


(14g) 

where is a lifted reformulation of such that Projj-^i 

= . Because the LP-based algorithm 


will consider auxiliary variables as formulation variables it will construct and refine a polyhedral relaxation 
of nonlinear constraints (14e) in the variable space. This will effectively construct a lifted polyhedral 

relaxation of using auxiliary variables z^. 

The nonlinear reformulation associated to the tower of variables relaxation from Corollary 1 is equal 
defined in (6). This reformulation uses auxiliary variables z^ = G £qj. dehned in Proposition 2 and 


corresponds to replacing (14e) with 

yo = ti^‘, VI G {1,... ,q} , (15a) 

t^° = yi, Vi G {l,...,di},l G {1,...,(7}, (15b) 

(4’''^\4-i-4'') e L", Vi G {1,..., h.fe/ 2 j}, fc G {0,. .., A; - 1}, 1 G {1,... ,g} , (15c) 

4^ = 4’nt/2] ’ Vfc G {0, ..., A/ - 1} s.t. ri^k is odd, 1 G {1,..., g} , (15d) 


where A/ and correspond to A and dehned in Proposition 2 for d = di. 
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The nonlinear reformulation associated to the separable relaxation described in Corollary 2 is equal to H“ 
defined in (12). This reformulation uses auxiliary variables 2 = ui € and corresponds to replacing (14e) with 




^ 1 1 

\/j£{l,...,di},l£{l,...,q}, 


(16a) 


d 

'?■ = ! 

VI 

yi£{l,...,q}, 


(16b) 


0 < Vo, 

yi£{l,...,q}. 


(16c) 

The final 

reformulation is a combination of the previous two that replaces in 

(15c) with 

H^. This 

reformulation 

uses auxiliary variables 

z^ = (t\v‘ 

' j G for R{d) and G{D) dehned in Proposition 2 

and := {2 : i G {1, ..., Ln_fc/2J}, A: G {0, ..., A; - 1}} where A; and {ri^k}kio correspond to A and 

defined in Proposition 2 for d = di. The version of constraint (14e) for this case is 


l J,K 

Vo — 1 

VI G {1, 



(17a) 


J,0 l 

h = Vi’ 

Vie {1, 

...,d},l £ {!,..., q} , 


(17b) 


f,l,k , l,kj,k+l 

Vie {1. 

...,[ri,k/2\},k£{0,...,Ki-l},l£{l,.. 


(17c) 


+ 

VI 

Vie {1, 

...,lri^k/2\},k£{0,...,Ki-l},l£{l,.. 

■ ,q} , 

(17d) 


l.k 1 l.k ^ ,l,k + l 

Vie {1, 

...,lri^k/2\},k£{0,...,Ki-l},l£{l,.. 

■ ,q}, 

(17e) 


,l,k ,l,k-\-l 

“ Pi,f=/2p 

Vfc G {0, 

..., A; - 1} s.t. ri^k is odd, 1 £ {l,...,q} . 


(17f) 


In Section 5 we compare the effectiveness of these nonlinear reformulations with two versions of the LiftedLP 
algorithm of [45], which we now describe in detail. 


4.2 Branch-based LiftedLP Algorithm and Cut-based Adaptation 


The original LiftedLP algorithm of [45] uses a version of introduced in [24]. This version corresponds to 
the static lifted polyhedral relaxation described by the following corollary. 

Corollary 3 Let K = [log2(d)] and {r^.}^_Q be defined by the recursion rg = d, r}^j^i = [rj,/2] for k € {0 ,... ,K — 
1}. Furthermore, for any e G (0,1/2) let 




k + 1 
2 


log4 


2log(l-h£)^ 


for each k £ {0,..., A — 1}. Finally, let Lg := T‘^ (A//, Dg) where 

A4:= {<(e) : ie{l,...,[rk/2\},k£{0,...,K-l}} 


and Dg := {2sfe (e) : i £ {1,..., [rj;/2J}, k £ {0 ,... ,K — 1}}. Then, Lg is a lifted polyhedral relaxation of 1/“ with 
approximation quality e and 0(dlog(l/£)) variables and eonstraints. 
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The LiftedLP algorithm replaces every occurrence with for an appropriately chosen e. To avoid the 
need to rehne these approximations the algorithm sporadically solves some nonlinear relaxations and follows a 
specialized branching convention. This branch-based approach to the LiftedLP algorithm was motivated by the 
ineffectiveness of traditional polyhedral relaxations of in certain classes of problems. However, the advent of 
dynamic lifted polyhedral relaxations suggests the possible effectiveness of a cut-based version of the LiftedLP 
algorithm. We now concurrently describe the original branch-based and the cut-based variant of the LiftedLP 
algorithm. The cut-based variant combines static relaxation with a dynamic relaxation of L'^. While any 
of the relaxations described in the previous section can be used, preliminary computational test showed that 
(r) provides comparable or better performance than the other relaxations. For this reason, and because the 
extension to other dynamic relaxations is straightforward, we here only describe the variant for H‘^ (P). 

Both versions of the LiftedLP algorithm are based on the LP relaxation of MICQP defined in (3) given by 


°’^jLP(i,u.{r‘}f_i) ca; (ISa) 

s.t. 


Ey < h, 



(18b) 

A^x + b'‘ = y\ 

/£{!,.. 

•, g}, 

(18c) 

1 , ,l 1 

a ■ x + bo =yo, 

/£{!,.. 

• ,g}, 

(18d) 

( 1 1 J l\ ^ rdi 

[y ,yo,t ,v ) & W, 

/£{!,.. 

• ,g}, 

(18e) 

(y‘,yl),w‘) £ (P') 

, /£{!,.. 

•, gj, 

(18f) 

Ij < Xj < Uj , 

j e {!,■ 

.. ,n} . 

(18g) 


where P* corresponds to the set of inequalities currently used by the algorithms. If P* = 0 for all 1 £ {1,..., q} 
constraints (18f) do not restrict (y^yo^ in any way, so we assume that in such case (18f) is simply omitted. 

Vectors 1, u £ (M U {— 00 , 00 } )" correspond to variable lower and upper bounds that are used to define a node 
in the branch-and-bound tree. These bounds are initially infinite (Ij = —00 an Uj = 00 for all j £ {!,... ,n}) 
and are only modihed for integer constrained variables Xj for j £ 7. The infinite bounds for the continuous 

variables are included to simplify notation. We denote the relaxation defined in (18) LP [l, u, |p^| ). The 


algorithms also use the following nonlinear relaxation to sporadically compute node-bounds or as a heuristic 
to find feasible solutions. 


objcp(Lu) :=max 
s.t. 


: cx 



(19a) 

Ey < h, 



(19b) 

A^x + b^ = y , 

1 £ {1,.. 

• ,g}, 

(19c) 

i , ,i i 

a ■ x + bo = yo, 

/ £ {1,.. 

■ ,g}, 

(19d) 

(y^yo) c 

1 £ {1,.. 

• ,g}, 

(19e) 

h < Xj < uj- 

j C {!,■ 

. .,n}. 

(19f) 


We denote this relaxation CP (1, u). 

The final ingredient in the algorithms is a list of branch-and-bound nodes to be processed, which we denote 
M. The nodes in this list are characterized by variable upper and lower bounds (1, u) and an estimated upper 
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bound of the nonlinear relaxation CP(l,u). The objective of the algorithm is to simulate a nonlinear branch- 
and-bound based on CP(1, u), but by solving LP ^1, u, |_r*| ^ in each node and only sporadically solving 

CP(l,u). A generic version of this procedure is described in Algorithm 2. The basis of Algorithm 2 is a branch- 


Algorithm 2: A Generic lifted LP-based Branch-and-Bound Algorithm. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 


Set global lower bound LB := — oo. 

Set 1^ := —oo, := +oo for all j G {1,..., n}. 

Set UBO = + 00 . 

Set node list M := {(P, u^, UB^)}. 

Set initial approximation := Pq for all I G {1,..., q}. 
while 7 ^ 0 do 

I Select and remove a node (P,u^,UB^) G A4. 

Solve 

if LP (P, u^, is feasible and ^ > LB then 

Let (x, {^Q, 2 ^) be the optimal solution to LP (P, u^, . 

if Xj G Z for all j £ I then 

if y^) G for all I £ {1,... ,q} then 

else 

Let Ij = \j, Uj = for all j G {1,..., n} \ 7. 

Let Ij = Uj = Xj for all j £ P 
Solve CP(1, u). 

if CP(1, u) is feasible and obj(-p^i > LB then 
I LB := objcp(i,u). 

end 

Call REFINE (l^ u^ { , LB, objLp(iy„;=), Ad, 

end 

else 

Pick jo in {j & 1 : Xj ^ Z}. 

Let Ij = 1*, uj = for all j S {1,..., n} \ {jo}- 

Let U jg = [Xjg J , ijg = [X jg j + l - 

M:=M U |(l'=,u,obj|_p(,fe , (l,u'=,objLp(,fe „(.))! 

end 

end 

I Remove every node (1*^, UB*^) S Ad such that UB*^ < LB. 

end 


/* Run Heuristic and Refine */ 


/* Branch on x */ 


and-bound procedure that solves LP 



in each branch-and-bound node. If the optimal value of 


this relaxation is worse than that of the incumbent feasible solution the node is fathomed by bound in line 9. 
If the optimal value is better than the incumbent and the solution to the LP relaxation does not satisfy the 
integrality constraints of MICQP, the algorithm branches on an integer constrained variable with a fractional 
value in the traditional way. This is done in lines 23-28 of the algorithm. If the optimal value is better than the 
incumbent and the solution of the LP relaxation satisfies the integrality constraints of MICQP, the algorithm 
first checks if the nonlinear constraints of MICQP happen to be satished in line 12. If the nonlinear constraints 
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are satisfied the incumbent solution is npdated in fine 13 (as stated the algorithm only npdates the value of 
the solution; the modification to update the solution itself is straightforward). If the nonlinear constraints are 
not satisfied, the algorithm first attempts to find a feasible solution to MICQP that has the same values in the 

integer variables as the solution to LP ^1, u, |/^*| ^ for the current node. This is done by solving CP(1, u) 

for appropriately chosen bounds in lines 15-17. If this heuristic is successful and yields a better solution the 
incumbent is updated in lines 18-20. Finally, a generic refinement procedure for the current branch-and-bound 
node is called in line 21. 

The original LiftedLP algorithm from [45] is obtained when we let Tq = 0 for all / G {1,..., g} and we use the 
branch-based refinement procedure described in Algorithm 3. The procedure begins by solving the nonlinear 


Algorithm 3: Branch-based refinement. 

Branch. REFINE (l^ u^ { (y\yl, rh') , LB, objLP(i. J 


1 

2 

3 

4 

5 

6 

7 

8 
g 

10 

11 

12 


Input: Lower and upper variable bounds solution { , lower bound LB, node bound 

node list A4 and cut list 
Solve CP(l^,u^). 

if CP(l^,u^) is feasible and obj(~p^jfc > LB then 

I Let be the optimal solution to CP(l^,u^). 

if G 'IP' then /* Fathom by Integrality */ 

I LB := 

else /* Branch on x^ */ 

Pick y'o in {y G 7 \ x^ 1 a}. 

Let \j = 1^, uy = for all y G {1,.. -, n} \ {y'o}. 

Let Ujg = [x^J, bo = [x^J+l. 

M := A4u{(F,u,objcp(,yufc)) , (l,u'=,objcp(iy„fc))} 

end 

end 


relaxation that would have been solved by an NLP-based branch-and-bound algorithm in the current node. 
The procedure then processes this node exactly as an NLP-based branch-and-bound algorithm would. In fine 
2 it first checks if the node can be fathomed by bound or infeasibility. If this fails, the procedure attempts to 
fathom by integrality in lines 4-6. Finally, if all the previous steps fail, the procedure branches on an integer 
constrained variable with a fractional value in lines 6-11. 

Finally, a cut-based version of the algorithm that truly uses obtained when we use the cut-based 

refinement procedure described in Algorithm 4. This procedure first checks for a violation of the nonlinear 
constraints by the current node’s solution in lines 1-2. If a violation is found, then the separation procedure 
for 77'’*' if^') called in line 3. This separation procedure updates P* with one or more inequality violated by 
the node solution. 
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Algorithm 4: Cut-based refinement, Cut. REFINE | 

Jl^u^{(y^y',tI;') 


[r'j 

CJ 

1 


Input: Lower and upper variable bounds solution { , lower bound LB, node bound Vipf^ik 

node list A4 and cut list 

1 for / = 1 to y do 

2 J if (y^,yQ) ^ then 

3 for ji = 1 to di do 

4 if then 

5 I Setr]-.= rjyj[y\/yl] 

6 end 

7 end 

8 end 

9 end 

10 X := X U |(l'“,u'=,objLp(ifc 


5 Computational Experiments 

In this section we compare the performance of the different algorithms on the portfolio optimization instances 
considered in [45] . We begin by describing the portfolio optimization instances and how the different algorithms 
are implemented. We then present the results of the computational experiments. 


5.1 Instances 

The instances from [45] correspond to three classes of portfolio optimization instances with limited diversifi¬ 
cation or cardinality constraints [7,8,14,40] which are formulated as MICQPs. All three problems construct 
a portfolio out of n assets with an expected return a £ R". The objective is to maximize the return of the 
portfolio subject to various risk constraints and limitation on the number of assets considered in the portfolio. 
To simplify the description of the three versions we deviate from the conventions of (1) and use different names 
for continuous and integer constrained variables. With this the first class of problems we consider are of the 
form 


max ax 

(20a) 

s.t. 


< a, 

II II 2 

(20b) 

II 

H 

(20c) 

j=i 


Xj<Zj, Vj G {l,...,n}. 

(20d) 

n 

(20e) 

j=i 


^€{0,1}", 

(20f) 

X e R+, 

(20g) 
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where x indicates the fraction of the portfolio invested in each asset, is the positive semidefinite square 

root of the covariance matrix of the returns of the stocks, a is the maximum allowed risk and K < n is the 
maximum number of assets that can be included in the portfolio. We refer to this class of instances as the 
classical instances. 

The second class of problems is obtained by replacing constraint (20b) with a shortfall constraint considered 
in [38,37]. This constraint can be formulated as 

<av-wl°^, Vi £{1,2} 

II Il2 

where Wl°'^ and rn are given parameters and <!>[■) is the cumulative distribution function of the Normal distri¬ 
bution with zero mean and unit standard deviation. We refer to this class of instances as the shortfall instances. 

The third and final class of problems correspond to a robust version of (20) introduced in [13]. This model 
introduces an additional continuous variable t, replaces the objective function (20a) with maxi and adds the 

constraint ax — a > t where is the positive semidefinite square root of a given matrix R and a 

II II 2 

is a given scalar parameter. We refer to this class of instances as the robust instances. 

We note that only the classical instances can be handled by the lifted polyhedral relaxation considered in 
[32]. 


5.2 Implementation and Computational Settings 

All algorithms and models were implemented using the JuMP modeling language [2,39] and solved with CPLEX 
vl2.6 [34] and Gurobi v5.6.3 [30]. The complete code for this implementation is available at https://github. 
com/juan-pablo-vielma/extended-MIQCP. 

Our base benchmark algorithms are CPLEX and Gurobi’s standard algorithms for solving MICQP. Both 
solvers implement an NLP-based branch-and-bound algorithm and a standard LP-based branch-and-bound 
algorithm. Each of these implementations include advanced features such as cutting planes, heuristics, pre¬ 
processing and elaborate branching and node selection strategies. We refer to the NLP-based algorithms as 
CPLEXCP and GurobiCP, and to the LP-based algorithms as CPLEXLP and GurobiLP. All four algorithms 
can be used by simply giving the model to the appropriate solver and setting a specialized parameter value. 

We also implemented a branch-based and a cut-based version of Algorithm 2. The branch-based version 
corresponds to the LiftedLP algorithm from [45] and its implementation requires access to a branch callback, 
which is not provided by Gurobi. For this reason we only implemented a CPLEX version similar to the original 
implementation from [45]. This version was developed using the branch, heuristic and incumbent callbacks 
for CPLEX provided by the CPLEX.jl library [1]. We refer to this algorithm as LiftedLP. Implementing the 
cut-based versions of Algorithm 2 only requires access to a lazy constraint callback and to a heuristic callback. 
These callbacks can be accessed for CPLEX and Gurobi through the solver independent callback interface 
provided by JuMP, which allowed us to implement a version of this algorithm that is not tied to either solver. 
We implemented the cut-based LiftedLP algorithm for all three lifted polyhedral relaxations considered in 
Section 4.1. However, as noted in Section 4.2, preliminary experiments showed that the version based on 
H'^ (r) provides comparable or better performance than the other two versions. For this reason we here only 
present results for that version, which corresponds to Algorithm 2 using the cut-based refinement described in 
Algorithm 4. We refer to the implementation of this algorithm using CPLEX and Gurobi as base solvers as 
CPLEXSepLazy and GurobiSepLazy respectively. 

Finally, instead of implementing LP-based algorithms that only use a dynamic lifted polyhedral relaxation 
(i.e. that does not use or we simply solve the three lifted reformulations described in Section 4.1 

with GPLEX and Gurobi’s LP-based algorithms. We refer to the implementations based on reformulation (15) 
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as CPLEXTowerLP and GurobiTowerLP, to the implementations based on reformulation (16) as CPLEXSe- 
pLP and GurobiSepLP and to the implementations based on reformulation (17) as GPLEXTowerSepLP and 
GurobiTowerSepLP. 


5.3 Results 

All computational results in this section are from tests on a Intel 17-3770 3.40GHz Linux workstation with 
32GB of RAM. All algorithms were limited to a single thread by appropriately setting CPLEX and Gurobi 
parameters and to a total run time of 3600 seconds. We consider the same portfolio optimization instances 
from [45], which correspond to the three classes of problems described in Section 5.1 for A = 10 and n e 
{10,20,30,40,50,60,100,200,300}. For each problem class and choice of n we test 100 randomly generated 
instances. We refer the reader to [45] for more details on how the instances were generated. All instances 
and results are available at https://github.com/juaii-pablo-vielma/extended-MIQCP. Results are presented in 
two types of charts. The first type are box-and-whisker charts generated by the BoxWhiskerGhart function in 
Mathematica vlO [48]. These charts consider solve times in seconds in a logarithmic scale and show the median 
solve times, 25% and 75% quantiles of the solve times and minimum and maximum solve times excluding 
outliers, which are shown as dots. We note that to ensure the graphs are easily legible in black and white print 
we use the same colors for each chart. Hence, a given algorithm may be assigned different colors in different 
charts. The second type are performance profiles introduced by Dolan and More [15] with solve time as a 
performance metric. Finally, tables with summary statistics for all methods and instances are included in the 
Appendix B.l. 


5.4 Comparison with Traditional Algorithms and Initial Calibration 

In this section we present some initial results that evaluate the difficulty of the considered instances, compare 
the lifted algorithms to standard algorithms and compare the dynamic lifted relaxations. Because the Classical 
and Shortfall instances are extremely difficult for many algorithms tested in this section we only consider 
n G {10,20,30,40,50,60} for these instances. Similarly we exclude n = 300 for the Robust instances. 

The first set of results are presented through box-and-whisker charts in Figure 1. These charts compare the 
performance of CPLEX and Gurobi’s NLP and LP-based algorithms (CPLEXCP, GurobiCP, CPLEXLP and 
GurobiLP). The results in [45] showed that NLP-based algorithms had a significant advantage over traditional 
LP-based algorithms for the portfolio optimization instances. Figure 1 shows that, for sufficiently large values 
of n, this advantage still holds for current versions of CPLEX and Gurobi. 

The second set of results are also presented through box-and-whisker charts in Figure 2. These charts com¬ 
pare the performance of the branch-based LiftedLP algorithm (LiftedLP) and the two NLP-based algorithms 
(CPLEXCP and GurobiCP). Figure 2 confirms that, for sufficiently large values of n, LiftedLP still provides 
an advantage over CPLEXCP and GurobiCP for the considered instances. 

The final set of results in this section compares the performance of the three dynamic lifted polyhedral 
relaxations in their nonlinear reformulation versions described in Section 4.1 (CPLEXSepLP, GurobiSepLP, 
CPLEXTowerLP, GurobiTowerLP, GPLEXTowerSepLP, GurobiTowerSepLP). This time the results are pre¬ 
sented through a performance profile in Figure 3. Figure 3 shows that for a fixed solver (CPLEX or Gurobi), 
the separable relaxation outperforms the other relaxation (i.e. CPLEXSepLP outperforms CPLEXTowerLP 
and GPLEXTowerSepLP, and GurobiSepLP outperforms GurobiTowerLP and GurobiTowerSepLP). Further¬ 
more, CPLEXSepLP and GurobiSepLP have comparable or better performance than all other combinations of 
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■ CPLEXCP ■ GurobiCP ■ CPLEXLP □ GurobiLP 
(a) Classical. 


■ CPLEXCP ■ GurobiCP ■ CPLEXLP □ GurobiLP 
(b) Shortfall. 



20 30 40 50 60 100 200 

Instance Size 

■ CPLEXCP ■ GurobiCP ■ CPLEXLP □ GurobiLP 
(c) Robust. 

Fig. 1 Solution times for standard LP-based and NLP-based algorithms [s]. 


solver and relaxation. These results align with our preliminary experiments which showed that the separable 
relaxation performed best among the cut-based LiftedLP algorithms considered in Section 4.2. Because the 
separable relaxation is additionally the simplest, from now on we concentrate on this relaxation among the 
three dynamic ones. Box-and-whisker charts with more details concerning this experiment are presented in 
Figure 6 in Appendix B.3. For instance, Figure 6 shows that the pure tower relaxation (CPLEXTowerLP and 
GurobiTowerLP) can provide an advantage over the separable relaxations (CPLEXSepLP and GurobiSepLP) 
for the smallest instances, but the combined tower-separable relaxation (CPLEXTowerSepLP and GurobiTow- 
erSepLP) is consistently outperformed by the other two. Additional details are also included in summary tables 
in Appendices B.l and B.2. The tables in Appendix B.l present summary statistics for solve times by class of 
instance and size, which can be used for even more detailed comparisons. Eor example, the tables conhrm the 
potential advantage of the tower relaxation for the smallest instances by showing that GurobiTowerLP is the 
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20 30 40 50 60 20 30 40 50 60 

Instance Size Instance Size 

■ LiftedLP ■ CPLEXCP ■ GurobiCP ■ LiftedLP ■ CPLEXCP ■ GurobiCP 

(a) Classical. (b) Shortfall. 



20 30 40 50 60 100 200 

Instance Size 

■ LiftedLP ■ CPLEXCP ■ GurobiCP 
(c) Robust. 


Fig. 2 Solution times for branch-based LiftedLP and NLP-based algorithms [s]. 


fastest option in 54 ont of the 100 shortfall instances for n = 20. The tables in Appendix B.2 present summary 
statistics for the feasibility quality of the solutions obtained. These statistics show that using the separable 
reformulation resulted in a signihcant reduction on the feasibility quality of the solutions obtained, particularly 
when using Gurobi. However, this reduction in quality is not surprising as errors in the 3-dimensional rotated 
conic constraints (16a) can easily add up to a larger error in the original conic constraint. Fortunately, this 
can be easily resolved by increasing the precision for constraints (16a) or by simply correcting the final or in¬ 
termediate incumbent solutions using the original conic constraint (i.e. by solving the original conic quadratic 
relaxation with the integer variables hxed appropriately). 
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Fig. 3 Performance profiles of solution times for dynamic lifted polyhedral relaxations solved by standard LP-based algorithms. 


5.5 Comparison between Lifted LP-based Algorithms 

In this section we compare the performance of the lifted algorithms. Classical and Shortfall instances are still 
extremely difhcult for many of these algorithms so we exclude results for n £ {200, 300} for these instances. 
We begin by comparing the branch-based (LiftedLP) and cut-based LiftedLP algorithms (CPLEXSepLazy and 
GurobiSepLazy) in Figure 4. The results show that all three methods have comparable overall performances. The 
cut-based algorithms do sometimes provide a computational advantage, particularly for the smaller instances. 
Furthermore, cut-based algorithms also have the practical advantage of being easily implemented for both 
CPLFX and Gurobi through JuMP. 

Our final set of experiments compare the branch-based and cut-based LiftedLP algorithms (LiftedLP, 
GPLFXSepLazy and GurobiSepLazy) the separable dynamic lifted polyhedral relaxation in its nonlinear refor¬ 
mulation version (CPLFXSepLP and GurobiSepLP). The results are presented through a performance prohle 
in Figure 5, which also includes the four traditional algorithms (CPLFXCP, GurobiGP, GPLFXLP and Guro- 
biLP) as a reference. Figure 5 conhrms that the traditional LP-based algorithms have the worst performance 
and are rather consistently outperformed by the NLP-based algorithms. In addition, the branch-based LiftedLP 
algorithm outperforms the traditional algorithms with the exception of CPLFX’s non-linear based algorithm 
(CPLEXCP). Furthermore, the additional advantage provided by the cut-based LiftedLP algorithms allows 
them to consistently outperform all traditional algorithms. However, the best performance is achieved by the 
separable dynamic lifted polyhedral relaxations in their nonlinear reformulation versions (CPLFXSepLP and 
GurobiSepLP). Again, box-and-whisker charts and summary statistics tables with more details concerning 
solve times and solution quality are included in Appendix B. One notable insight from these tables is that the 
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20 30 40 50 60 100 

Instance Size 

B LiftedLP | CPLEXSepLazy B GurobiSepLazy 
(a) Classical. 


20 30 40 50 60 100 

Instance Size 

B LiftedLP B CPLEXSepLazy B GurobiSepLazy 
(b) Shortfall. 



20 30 40 50 60 100 200 300 

Instance Size 

B LiftedLP B CPLEXSepLazy B GurobiSepLazy 
(c) Robust. 

Fig. 4 Solution times branch-based and cut-based LiftedLP algorithms [s]. 


cut-based LiftedLP algorithms can be competitive for the hardest instances. For instance, CPLEXSepLazy was 
the fastest option in 37 out of the 100 shortfall instances for n = 100. 

The JuMP implementation of the cnt-based LiftedLP algorithms results on an extremely flexible framework 
that can signihcantly outperform traditional algorithms. On the other hand, the separable reformulation pro¬ 
vides a consistently better performance without the need for callbacks or any additional programming beyond a 
simple transformation of the conic constraints. A possible explanation of this performance may be that callbacks 
interfere with (or even result in the deactivation of) advanced features of the MICQP solvers (e.g. CPLEX turns 
off the dynamic search feature when control callbacks such as heuristic, lazy constraint and branch callbacks 
are used [33]). Hence, it is possible that an internal implementation of the LiftedLP algorithms may provide an 
advantage in some classes of problems. Furthermore, from a purely theoretical standpoint (i.e. disregarding the 
mentioned algorithmic details and implementation issues), the only difference between the cut-based LiftedLP 

















































24 


Vielma et al. 


-o 

'o 




CPLEXCP 
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CPLEXSepLazy 


GurobiCP 
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Fig. 5 Solution times for static and dynamic lifted LP-based, standard LP-based and standard NLP-based algorithms [s]. 


algorithms and the separable reformulation algorithms is the inclusion of the Ben-Tal and Nemirovski lifted 
polyhedral relaxation by the first class of algorithms. This suggests that including as an initial polyhedral 
relaxation can sometimes be useful for large instances. 


6 Possible Extensions and Open Questions 

The computational results show that the separable reformulations provide a clear advantage over the original 
LiftedLP algorithm and standard LP-based and NLP-based algorithms for all three variants of the portfolio 
optimization problem. However, a further strengthening of the reformulation may be possible for the classical 
instances. In addition, some theoretical questions remain about the approximation quality provided by the 
reformulation. 


6.1 Formulation Strengthening for Portfolio Optimization Through Perspective Reformulations 

The relation between the separable reformulation and perspective formulations of unions of convex sets de¬ 
scribed in Section 3.1 can also be used to strengthen the separable reformulation for the classical portfolio 
optimization instances (20) for = /. If we rewrite (20b) using separable reformulation defined in (12) 
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we obtain 


Xq < a, 



(21a) 

2 / 

Xj < WjXo, 

Vje 

. ,n}. 

(21b) 

d 

Wj < xo, 

J=1 



(21c) 

7=1 



(21d) 

Xj ^ Zj , 

Vi £{!,.. 

. ,n}. 

(21e) 

71 

7=1 



(21f) 

{o,ir. 



(21g) 

* G 1R+. 



(21h) 


However, using known results (e.g. [42] and Section 3.4 of [28]), we may replace (21a)-(21b) with 

a^o < (22a) 

^ {li ■ ■ ■ jti} (22b) 

to obtain a stronger formulation. Having = 7 is essential for this improvement, but extending it to general 
may be possible by using other known techniques [16,20,35]. 

6.2 Approximation Quality of Dynamic Lifted Polyhedral Relaxations 

It is well known that constructing a non-lifted (i.e. m 2 = 0 in Definition 1) polyhedral relaxation of with 
approximation quality e in (5), requires at least exp inequalities [4]. Hence, as discussed just 

before Proposition 3, the approximation quality of and given by Proposition 2 and Corollary 3 seems 
strongly dependent on the fact that the projection of A| onto the variables y has an exponential in s number 
of inequalities. This suggests that neither the tower of variables nor the separable polyhedral relaxations can 
achieve the approximation efficiency of with regard to number of linear inequalities. However it would 

still be interesting to understand what level of efficiency these approximations can achieve. We formalize this 
in the following open questions. 

Question 1 (Smallest tower of variables polyhedral relaxation) Let 

72:= {72,,fc : i G {1,..., [4/2J}, fc G {0,..., 7^ - 1}} 

be such that 72^,^. C and m{f2) := 

For a given e > 0, what is the smallest m (72) such that T‘^ (72) is a polyhedral relaxation of with 
approximation quality e? 

Question 2 (Smallest separable polyhedral relaxation) Let F ■.= ^Fj : jG{l,...,n}} and m(F) := 1 |A|- 

For a given e > 0, what is the smallest m (F) such that 77^^ (F) is a polyhedral relaxation of with 
approximation quality e? 
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Finally, [6] shows that are essentially the smallest possible (static or dynamic) polyhedral relax¬ 

ations of with an approximation quality e. Then some natural follow-up questions are: what is the smallest 
possible size of a dynamic polyhedral relaxation of L^, and how close are the tower of variables and separable 
approximations to this lower bound. 
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A Proof of Proposition 4 

To prove Proposition 4 we begin with the following lemma, which gives a characterization of the homogenization of a convex 
set described by nonlinear constraints. 
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Lemma 1 Let f : ^ R 6 e a closed convex function such that = oo so that the closure of the perspective 

function of f is given by 

(tf{x/t) t>0 

(ij a:) = < 0 X = 0 and t = 0 . 

I oo o.w. 

//€:={?; SR'* : f{y)<l}, then 

cone({l} X C) = fyo,y) 6 R'^^^ : (^clf {yo,y) < yo} • (23) 

Proof Let D := fyo,y) S R'*'*"^ : {yo>y) ^ ?/o|' We have {1} X C C D and D is a convex cone because {yo^y) is 

a homogeneous function, so cone({l} x C) C D. 

For the reverse inclusion, let {yo,y) E D. If yo = 0 then ^ = 0 and hence {yo,y) E cone({l} x C). If j/o >0 then 
{yo,y) /yo E {1} x C and hence {yo,y) E cone({l} x C). 


The final ingredient for the proof of Proposition 4 is the following lemma that shows how to translate the polyhedral 
approximation for univariate functions to their homogenization. 

f(x) 

Lemma 2 Let f : M. 'R be a closed convex differentiable function such that lim:r—>-oo Then 

\x\ 

epi {df : = fyo,y,w) e R® : {clf {yo,y) < «)} 

= {(yo,2/,'U') e R^ : (/(7) - 7 /'(7)) yo +/'(7) y <'^ V 7 eR}. 

Furthermore, {yo, y, w) S epi */ only if either yo = y = 0 < w or if yo > 0 and 

(/( 7 (yo,y)) - 7 (yo,y)/' ( 7 (yo,y))) yo + /' ( 7 (yo,y))y < w ( 24 ) 

for 7 (yo, y) defined in Corollary 2. 


Proof First note that D := {{yo,y, : if ( 7 ) 

cone ((1| X epi(f)) and 

epi(/) = {(y.^)) 6 R^ 


~ 7 /^ (7)) yo + f' (7) y w V 7 E R} is a closed convex cone, epi 

; (/ (7) - 7/' (7)) + /' (7) y < ^ V7 E R}. 


Then {1} x epi (/) C D implies epi ^ 

For the reverse inclusion, let (yo,y, w) E D. We first show that yo > 0, by assuming yo < 0 and reaching a contradiction. For 
this we consider cases y ^ 0 and y = 0 separately. For both cases note that lima;^oo implies that limj;^+oo f'(^) = +00 

\x\ 

and lim^_)._oo f'{x) = - 00 . 

For case y 7 ^: 0, note that if yo < 0, then yo/(0) ^ yo if (7) ~ 7 /^ (7)) foi" all 7 E R by convexity of /. Hence, if (yo^y-, ic) E D 
and yo < 0 then 

yofio) + f i'y)y<w (25) 


for all 7 E R. Taking limit for 7 ^ 00 when y > 0 and for 7 —00 when y < 0 in (25) we arrive at a contradiction with 

w < 00 . 

For case y = 0, note that by convexity of / and the mean value theorem we have that / ( 7 ) — 7 /' ( 7 ) < / ( 70 ) — f' ( 7 ) 70 
for any 0 < 70 < 7 . Then, lim-y-^-oo / ( 7 ) — 7 /^ ( 7 ) = — 00 . Now, if (yo, y, ED and y = 0 then 


(/ (7) - 7/' (7)) yo<w 


(26) 


for all 7 E R. Then, if yo < 0, by taking limit for 7 ^ 00 in (26) we again arrive at a contradiction with it; < 00 . 


If). 


We now show that any (yo,y,in) E D with yo > 0 also belongs to epi (cl 

yo > 0. 

For case, yo = 0, note that (yo, n;) E D implies f' ( 7 ) y < w for all 7 E R. Taking limit for 7 


We divide the proof into cases yo = 0 and 
00 when y > 0 and for 


7 —>■ —00 when y < 0, we conclude that y = 0 and w >0. Hence, (yo, y, w) E epi (^clj 

For case, yo > 0 we can check that (y,it;)/yo E epi (/) and then (yo, y, n^)/yo E {1} x epi(/). Hence, (yo,y,ir>) E 


If). 


If). 


cone ({1} X epi (/)) C epi l^clj 

For the final statement, it suffices to prove that (yo,y, n^) E epi if yo > 0 and (yo,y, it?) satisfies (24). For this note 

that, if the last two conditions hold, then (y, w) /yo E epi (/), which we have already shown implies (yo, y, w) E epi . 
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Combining these lemmas we obtain the following straightforward proof of Proposition 4. 


Proof (of Proposition f) Let f(y) = fjiVj)- Then (11) follows by noting that by Lemma 1 we have cone({l} x C) = 

(yo,y) s : (cZ/) {yo,y) < yo} and by the definition of perspective function we have (cZ/) {yo,y) = {ph') (zzo,ZZj)- 

All other statements are directly from Lemma 2 and from Proposition 3 by fixing yo = 1- 


B Additional Graphs and Tables 


B.l Summary Statistics for Solve Times 


Tables 1—8 show some summary statistics for the solve times for the different algorithms and instances. These statistics include 
the minimum, average and maximum solve times, together with their standard deviation. The tables also include the number 
of each solver was the fastest (wins) and the number of times a solver has a solution time that was within 1% and 10% of the 
fastest solver (1% and 10% win). 
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Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

CPLEXCP 

0.01 

0.23 

2.06 

0.30 

0 

0 

2 

GurobiCP 

0.03 

0.17 

2.22 

0.31 

0 

0 

0 

CPLEXLP 

0.02 

1.23 

16.67 

2.69 

0 

0 

0 

GurobiLP 

0.01 

1.63 

26.48 

4.04 

0 

0 

0 

LiftedLP 

0.03 

0.53 

6.44 

0.74 

0 

0 

0 

GPLEXSepLp 

0.01 

0.09 

0.53 

0.09 

4 

4 

6 

GPLEXTowerLp 

0.01 

0.11 

0.71 

0.10 

0 

0 

3 

GPLEXTowerSepLp 

0.01 

0.23 

1.49 

0.23 

0 

0 

0 

GurobiSepLp 

0.01 

0.03 

0.18 

0.02 

58 

58 

76 

GurobiTowerLp 

0.01 

0.03 

0.21 

0.03 

38 

38 

58 

GurobiTowerSepLp 

0.01 

0.15 

1.06 

0.22 

0 

0 

0 

GPLEXSepLazy 

0.01 

0.16 

0.74 

0.14 

0 

0 

0 

GurobiSepLazy 

0.02 

0.17 

0.98 

0.18 

0 

0 

0 



(a) 

Classical. 




Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

GPLEXGP 

0.01 

0.23 

0.91 

0.18 

1 

1 

1 

GurobiCP 

0.02 

0.76 

6.12 

1.32 

2 

2 

3 

CPLEXLP 

0.01 

0.69 

13.57 

1.59 

0 

0 

1 

GurobiLP 

0.02 

0.97 

16.03 

2.18 

0 

0 

0 

LiftedLP 

0.11 

0.82 

6.27 

0.95 

0 

0 

0 

GPLEXSepLp 

0.01 

0.15 

0.81 

0.13 

2 

2 

3 

GPLEXTowerLp 

0.01 

0.12 

0.42 

0.09 

5 

5 

6 

GPLEXTowerSepLp 

0.03 

0.29 

0.80 

0.19 

1 

1 

1 

GurobiSepLp 

0.01 

0.04 

0.12 

0.02 

35 

37 

53 

GurobiTowerLp 

0.01 

0.04 

0.14 

0.02 

54 

55 

67 

GurobiTowerSepLp 

0.03 

0.17 

1.15 

0.19 

0 

0 

0 

GPLEXSepLazy 

0.03 

0.28 

0.98 

0.19 

0 

0 

0 

GurobiSepLazy 

0.03 

0.21 

0.97 

0.15 

0 

0 

0 



(b) 

Shortfall. 




Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

CPLEXCP 

0.01 

0.10 

0.55 

0.10 

19 

20 

33 

GurobiCP 

0.03 

0.09 

0.41 

0.05 

0 

0 

0 

CPLEXLP 

0.01 

0.23 

1.14 

0.17 

0 

0 

0 

GurobiLP 

0.01 

0.07 

1.05 

0.14 

17 

17 

30 

LiftedLP 

0.14 

4.03 

81.41 

9.25 

0 

0 

0 

GPLEXSepLp 

0.01 

0.08 

0.34 

0.08 

7 

9 

30 

GPLEXTowerLp 

0.01 

0.07 

0.32 

0.07 

16 

18 

33 

GPLEXTowerSepLp 

0.03 

0.15 

0.61 

0.14 

0 

0 

0 

GurobiSepLp 

0.01 

0.03 

0.07 

0.01 

39 

40 

48 

GurobiTowerLp 

0.01 

0.04 

0.20 

0.03 

2 

2 

5 

GurobiTowerSepLp 

0.03 

0.08 

0.36 

0.06 

0 

0 

0 

GPLEXSepLazy 

0.03 

0.12 

0.35 

0.09 

0 

0 

0 

GurobiSepLazy 

0.03 

0.12 

0.40 

0.09 

0 

0 

0 


(c) Robust. 


Table 1 Summary statistics of Solve Times for n = 20 [s]. 
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Algorithm 

min 

avg 

max 

std 

wins 

1% win 

10 % win 

CPLEXCP 

0.14 

2.44 

91.52 

9.54 

0 


0 


0 

GurobiCP 

0.08 

2.95 

124.47 

12.81 

0 


0 


0 

CPLEXLP 

0.08 

101.30 

2795.96 

391.38 

0 


0 


0 

GurobiLP 

0.05 

174.52 

3600.01 

605.37 

0 


0 


0 

LiftedLP 

0.11 

1.35 

15.74 

2.10 

0 


0 


0 

GPLEXSepLp 

0.01 

0.49 

4.45 

0.72 

1 


2 


2 

GPLEXTowerLp 

0.01 

0.68 

8.36 

1.15 

0 


0 


1 

GPLEXTowerSepLp 

0.02 

1.49 

21.18 

2.65 

0 


0 


0 

GurobiSepLp 

0.01 

0.21 

3.94 

0.46 

65 


66 


72 

GurobiTowerLp 

0.02 

0.27 

5.83 

0.69 

34 


37 


46 

GurobiTowerSepLp 

0.04 

2.65 

96.69 

10.10 

0 


0 


0 

GPLEXSepLazy 

0.03 

0.80 

9.53 

1.38 

0 


0 


0 

GurobiSepLazy 

0.04 

1.59 

51.04 

5.30 

0 


0 


0 



(a) Classical. 







Algorithm 

min 

avg 

max 

std 

wins 

1 % 

win 

10 % 

win 

GPLEXGP 

0.05 

2.04 

20.97 

3.31 

0 


0 


0 

GurobiGP 

0.04 

11.88 

154.60 

22.32 

0 


0 


0 

GPLEXLP 

0.02 

22.79 

406.01 

62.02 

0 


0 


0 

GurobiLP 

0.05 

42.13 

989.04 : 

L 45.49 

0 


0 


0 

LiftedLP 

0.17 

1.55 

7.20 

1.23 

0 


0 


0 

GPLEXSepLp 

0.03 

0.72 

8.32 

0.90 

4 


4 


4 

GPLEXTowerLp 

0.02 

0.75 

7.74 

0.97 

2 


2 


2 

GPLEXTowerSepLp 

0.05 

1.90 

21.70 

2.69 

0 


0 


0 

GurobiSepLp 

0.02 

0.23 

2.87 

0.43 

94 


94 


95 

GurobiTowerLp 

0.03 

0.83 

8.87 

1.53 

0 


0 


1 

GurobiTowerSepLp 

0.05 

2.09 

25.97 

4.25 

0 


0 


0 

GPLEXSepLazy 

0.03 

1.21 

7.64 

1.11 

0 


0 


0 

GurobiSepLazy 

0.10 

1.39 

13.96 

2.24 

0 


0 


0 



(b) Shortfall. 







Algorithm 

min 

avg 

max 

std 

wins 

1 % 

win 

10 % 

win 

CPLEXCP 

0.02 

0.41 

2.12 

0.39 

4 


4 


8 

GurobiCP 

0.12 

0.69 

8.47 

1.35 

0 


0 


0 

CPLEXLP 

0.06 

1.56 

33.38 

4.20 

0 


0 


0 

GurobiLP 

0.02 

0.68 

11.97 

1.69 

6 


6 


11 

LiftedLP 

0.16 

23.53 

666.01 

77.12 

0 


0 


0 

GPLEXSepLp 

0.02 

0.26 

0.84 

0.23 

15 


16 


23 

GPLEXTowerLp 

0.02 

0.25 

1.14 

0.25 

11 


11 


18 

GPLEXTowerSepLp 

0.05 

0.55 

2.67 

0.54 

0 


0 


0 

GurobiSepLp 

0.02 

0.10 

1.33 

0.14 

62 


62 


64 

GurobiTowerLp 

0.02 

0.16 

0.96 

0.19 

2 


2 


3 

GurobiTowerSepLp 

0.05 

0.38 

2.67 

0.48 

0 


0 


0 

GPLEXSepLazy 

0.04 

0.35 

1.68 

0.26 

0 


0 


0 

GurobiSepLazy 

0.06 

0.39 

1.84 

0.34 

0 


0 


0 


(c) Robust. 


Table 2 Summary statistics of Solve Times for n = 30 [s]. 
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Algorithm 

min 

avg 

max 

std 

wins 

1 % 

win 

10 % 

win 

CPLEXCP 

0.33 

17.43 

568.02 

58.58 

0 


0 


0 

GurobiCP 

0.21 

24.56 

847.80 

88.11 

0 


0 


0 

CPLEXLP 

0.62 

731.57 

3600.42 

1132.98 

0 


0 


0 

GurobiLP 

0.64 

1157.74 

3600.30 

1462.59 

0 


0 


0 

LiftedLP 

0.37 

5.36 

60.57 

9.19 

0 


0 


0 

GPLEXSepLp 

0.13 

3.42 

70.71 

7.78 

3 


4 


5 

GPLEXTowerLp 

0.20 

4.89 

102.78 

12.01 

1 


1 


1 

GPLEXTowerSepLp 

0.28 

10.43 

207.66 

24.01 

0 


0 


0 

GurobiSepLp 

0.05 

1.28 

28.18 

3.24 

94 


95 


96 

GurobiTowerLp 

0.11 

8.85 

249.85 

26.53 

1 


1 


1 

GurobiTowerSepLp 

0.17 

21.59 

646.23 

67.72 

0 


0 


0 

GPLEXSepLazy 

0.20 

5.78 

111.98 

14.02 

0 


0 


0 

GurobiSepLazy 

0.24 

10.71 

415.53 

42.17 

1 


1 


1 



(a) Classical. 







Algorithm 

min 

avg 

max 

std 

wins 

1 % 

win 

10 % 

win 

GPLEXGP 

0.64 

29.08 

1168.34 

118.88 

0 


0 


0 

GurobiCP 

0.40 

152.28 

1416.22 

293.82 

0 


0 


0 

CPLEXLP 

0.78 

325.52 

3600.01 

738.07 

0 


0 


0 

GurobiLP 

0.55 

685.09 

3600.86 

1160.38 

0 


0 


0 

LiftedLP 

0.95 

9.23 

379.92 

38.05 

1 


1 


2 

GPLEXSepLp 

0.33 

4.34 

64.07 

8.61 

3 


4 


6 

GPLEXTowerLp 

0.22 

4.43 

84.74 

9.68 

1 


1 


1 

GPLEXTowerSepLp 

0.64 

11.51 

168.16 

21.32 

0 


0 


0 

GurobiSepLp 

0.08 

2.45 

74.77 

7.90 

93 


93 


96 

GurobiTowerLp 

0.12 

8.80 

218.17 

23.77 

0 


0 


0 

GurobiTowerSepLp 

0.31 

31.74 

1393.77 

141.23 

0 


0 


0 

GPLEXSepLazy 

0.55 

5.45 

52.10 

7.71 

2 


2 


3 

GurobiSepLazy 

0.39 

13.79 

578.08 

58.35 

0 


0 


0 



(b) Shortfall. 







Algorithm 

min 

avg 

max 

std 

wins 

1% win 

10 % win 

CPLEXCP 

0.04 

1.86 

43.15 

4.95 

2 


2 


2 

GurobiCP 

0.08 

1.92 

41.76 

6.11 

0 


0 


0 

CPLEXLP 

0.08 

22.79 

1197.49 

130.23 

0 


0 


0 

GurobiLP 

0.02 

21.77 

1392.90 

149.35 

4 


4 


10 

LiftedLP 

0.78 

114.09 

3600.00 

530.85 

0 


0 


1 

GPLEXSepLp 

0.03 

0.71 

8.93 

1.10 

9 


9 


11 

GPLEXTowerLp 

0.03 

0.84 

13.61 

1.79 

8 


8 


13 

GPLEXTowerSepLp 

0.07 

1.87 

34.23 

3.97 

0 


0 


0 

GurobiSepLp 

0.03 

0.26 

4.54 

0.51 

69 


69 


74 

GurobiTowerLp 

0.03 

0.83 

19.90 

2.66 

7 


7 


13 

GurobiTowerSepLp 

0.07 

2.07 

52.12 

6.82 

0 


0 


0 

GPLEXSepLazy 

0.06 

0.85 

7.78 

1.24 

1 


1 


1 

GurobiSepLazy 

0.10 

1.30 

32.36 

3.54 

0 


0 


0 


(c) Robust. 


Table 3 Summary statistics of Solve Times for n = 40 [s]. 
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Algorithm 

min 

avg 

max 

std 

wins 

1% win 

10 % win 

CPLEXCP 

0.43 

188.32 

3600.25 

511.63 

0 

0 

0 

GurobiCP 

0.33 

254.29 

3600.01 

619.08 

0 

0 

0 

CPLEXLP 

0.52 

1941.58 

3600.07 

1515.59 

0 

0 

0 

GurobiLP 

1.06 

2375.47 

3608.86 

1488.32 

0 

0 

0 

LiftedLP 

0.73 

42.46 

1368.69 

147.18 

1 

1 

2 

GPLEXSepLp 

0.14 

21.88 

471.47 

57.54 

7 

8 

9 

GPLEXTowerLp 

0.24 

33.96 

858.26 

104.09 

1 

1 

2 

GPLEXTowerSepLp 

0.57 

67.57 

1957.18 

210.80 

0 

0 

0 

GurobiSepLp 

0.07 

21.63 

1255.85 

126.13 

87 

88 

91 

GurobiTowerLp 

0.08 

102.69 

3600.00 

382.69 

0 

0 

1 

GurobiTowerSepLp 

0.31 

197.25 

3600.00 

501.15 

0 

0 

0 

GPLEXSepLazy 

0.30 

28.20 

384.63 

65.40 

4 

4 

4 

GurobiSepLazy 

0.32 

88.79 

3600.00 

369.09 

0 

0 

0 



(a) Classical. 





Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

GPLEXGP 

1.01 

160.11 

3600.22 

427.35 

0 

0 

0 

GurobiGP 

0.53 

1148.66 

3600.02 

1460.67 

0 

0 

0 

GPLEXLP 

0.62 

1231.56 

3600.44 

1446.50 

0 

0 

0 

GurobiLP 

0.32 

1773.43 

3658.96 

1614.40 

0 

0 

0 

LiftedLP 

0.94 

28.42 

1000.65 

102.41 

2 

3 

3 

GPLEXSepLp 

0.35 

16.64 

458.53 

48.68 

12 

12 

15 

GPLEXTowerLp 

0.35 

24.49 

889.35 

90.93 

4 

4 

5 

GPLEXTowerSepLp 

0.54 

77.90 

2216.07 

261.45 

0 

0 

0 

GurobiSepLp 

0.12 

20.27 

876.51 

91.10 

78 

79 

79 

GurobiTowerLp 

0.19 

74.46 

3600.00 

363.09 

1 

1 

1 

GurobiTowerSepLp 

0.58 

147.20 

3600.00 

405.19 

0 

0 

0 

GPLEXSepLazy 

0.62 

21.93 

572.22 

62.57 

3 

3 

6 

GurobiSepLazy 

0.44 

74.11 

3562.78 

359.48 

0 

0 

0 



(b) Shortfall. 





Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

GPLEXGP 

0.06 

9.35 

226.54 

31.22 

3 

3 

3 

GurobiGP 

0.12 

10.76 

355.45 

42.73 

0 

0 

0 

GPLEXLP 

0.27 

133.90 

3600.02 

563.01 

0 

0 

0 

GurobiLP 

0.04 

162.41 

3604.89 

709.57 

3 

4 

4 

LiftedLP 

0.92 

62.95 

3600.01 

365.07 

1 

1 

1 

GPLEXSepLp 

0.04 

1.95 

20.83 

3.70 

14 

14 

19 

GPLEXTowerLp 

0.04 

2.92 

72.92 

8.85 

1 

1 

3 

GPLEXTowerSepLp 

0.10 

7.49 

190.99 

23.24 

0 

0 

0 

GurobiSepLp 

0.04 

1.64 

57.29 

6.40 

71 

71 

77 

GurobiTowerLp 

0.05 

4.75 

103.85 

16.26 

6 

6 

11 

GurobiTowerSepLp 

0.14 

11.63 

253.89 

39.10 

0 

0 

0 

GPLEXSepLazy 

0.11 

2.65 

45.20 

6.24 

1 

1 

1 

GurobiSepLazy 

0.12 

4.40 

76.78 

12.17 

0 

0 

0 


(c) Robust. 


Table 4 Summary statistics of Solve Times for n = 50 [s]. 
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Algorithm 

min 

avg 

max 

std 

wins 

1% win 

10 % win 

CPLEXCP 

0.63 

440.28 

3602.68 

851.14 

0 

0 

0 

GurobiCP 

0.57 

574.65 

3600.00 

1016.49 

0 

0 

0 

CPLEXLP 

3.50 

2664.89 

3601.10 

1354.02 

0 

0 

0 

GurobiLP 

4.35 

2969.53 

3617.48 

1237.05 

0 

0 

0 

LiftedLP 

1.71 

141.92 

3471.98 

452.83 

1 

1 

2 

GPLEXSepLp 

0.31 

68.85 

1293.39 

174.87 

4 

4 

8 

GPLEXTowerLp 

0.38 

110.91 

2728.20 

318.85 

0 

0 

1 

GPLEXTowerSepLp 

0.67 

212.91 

3600.00 

526.40 

0 

0 

0 

GurobiSepLp 

0.08 

80.51 

3600.00 

374.64 

74 

75 

77 

GurobiTowerLp 

0.15 

254.80 

3600.00 

649.20 

0 

0 

0 

GurobiTowerSepLp 

0.31 

477.73 

3600.00 

886.20 

0 

0 

0 

GPLEXSepLazy 

0.54 

56.38 

1100.44 

149.15 

20 

20 

20 

GurobiSepLazy 

0.53 

200.00 

3600.00 

541.28 

1 

1 

1 



(a) Classical. 





Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

GPLEXGP 

1.58 

447.80 

3600.00 

849.68 

0 

0 

0 

GurobiGP 

4.71 

1947.87 

3600.03 

1594.42 

0 

0 

0 

GPLEXLP 

2.51 

2065.17 

3601.08 

1569.51 

0 

0 

0 

GurobiLP 

1.61 

2440.88 

3609.79 

1453.93 

0 

0 

0 

LiftedLP 

2.55 

75.88 

1793.78 

211.91 

9 

9 

10 

GPLEXSepLp 

0.82 

61.51 

2284.68 

234.88 

9 

9 

13 

GPLEXTowerLp 

0.51 

97.22 

3600.95 

406.79 

2 

3 

3 

GPLEXTowerSepLp 

1.93 

238.37 

3600.00 

558.70 

0 

0 

0 

GurobiSepLp 

0.16 

84.67 

3600.00 

383.37 

65 

65 

68 

GurobiTowerLp 

0.32 

181.66 

3600.00 

493.36 

0 

0 

1 

GurobiTowerSepLp 

0.75 

386.34 

3600.01 

772.94 

0 

0 

0 

GPLEXSepLazy 

1.56 

59.45 

1643.17 

175.33 

15 

15 

18 

GurobiSepLazy 

1.07 

141.33 

3600.00 

416.08 

0 

0 

0 



(b) Shortfall. 





Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

GPLEXGP 

0.08 

12.35 

325.85 

34.59 

1 

1 

1 

GurobiGP 

0.61 

21.46 

1006.61 

103.22 

0 

0 

0 

GPLEXLP 

0.52 

197.03 

3600.02 

608.43 

0 

0 

0 

GurobiLP 

0.07 

211.17 

3600.01 

681.26 

1 

1 

2 

LiftedLP 

1.43 

71.35 

3600.01 

399.94 

3 

3 

4 

GPLEXSepLp 

0.41 

2.77 

26.13 

3.25 

10 

10 

16 

GPLEXTowerLp 

0.06 

4.12 

62.27 

7.32 

2 

2 

3 

GPLEXTowerSepLp 

0.15 

9.01 

124.45 

14.65 

0 

0 

0 

GurobiSepLp 

0.13 

2.28 

29.70 

4.60 

71 

72 

73 

GurobiTowerLp 

0.09 

5.29 

113.54 

13.76 

11 

11 

14 

GurobiTowerSepLp 

0.21 

14.59 

300.93 

37.99 

0 

0 

0 

GPLEXSepLazy 

0.17 

3.31 

36.10 

4.39 

0 

0 

2 

GurobiSepLazy 

0.23 

5.10 

64.45 

9.08 

1 

1 

2 


(c) Robust. 


Table 5 Summary statistics of Solve Times for n = 60 [s]. 
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Algorithm 

min 

avg 

max 

std 

wins 

1 % 

win 

10 % 

win 

LiftedLP 

6.62 

1624.83 

3600.02 

1471.37 

3 


17 


22 

CPLEXSepLp 

1.66 

1484.69 

3600.21 

1403.10 

14 


28 


33 

GurobiSepLp 

0.34 

1439.88 

3600.31 

1437.49 

42 


56 


57 

CPLEXSepLazy 

2.98 

1452.46 

3600.02 

1463.32 

40 


40 


45 

GurobiSepLazy 

2.55 

2155.33 

3600.02 

1477.84 

1 


15 


16 



(a) Classical. 






Algorithm 

min 

avg 

max 

std 

wins 

1 % 

win 

10 % 

win 

LiftedLP 

13.16 

1345.62 

3600.12 

1391.11 

19 


24 


30 

GPLEXSepLp 

2.39 

1232.79 

3600.11 

1302.56 

14 


22 


27 

GurobiSepLp 

0.58 

1493.44 

3600.19 

1493.08 

29 


37 


40 

CPLEXSepLazy 

5.16 

1129.58 

3600.12 

1305.08 

37 


42 


46 

GurobiSepLazy 

3.73 

2081.67 

3600.08 

1506.22 

1 


8 


8 



(b) Shortfall. 






Algorithm 

min 

avg 

max 

std 

wins 

1% win 

10 % win 

CPLEXCP 

3.62 

162.04 

2043.65 

375.08 

0 


0 


0 

GurobiCP 

2.55 

196.83 

3600.03 

509.70 

0 


0 


0 

CPLEXLP 

2.00 

1056.43 

3600.10 

1362.59 

0 


0 


0 

GurobiLP 

0.47 

1079.13 

3603.90 

1472.19 

1 


1 


1 

LiftedLP 

4.27 

71.45 

3430.89 

345.06 

2 


2 


6 

GPLEXSepLp 

1.38 

17.48 

144.82 

26.37 

25 


25 


30 

GPLEXTowerLp 

0.99 

29.77 

535.74 

62.07 

0 


0 


0 

GPLEXTowerSepLp 

2.42 

104.37 

2712.22 

324.25 

0 


0 


0 

GurobiSepLp 

0.39 

32.04 

595.06 

86.96 

57 


57 


59 

GurobiTowerLp 

0.62 

58.55 

658.53 

124.77 

5 


6 


7 

GurobiTowerSepLp 

1.01 

167.12 

1750.92 

343.94 

0 


0 


0 

GPLEXSepLazy 

1.73 

23.22 

229.88 

41.66 

7 


7 


10 

GurobiSepLazy 

1.43 

54.06 

706.76 

126.63 

3 


3 


5 


(c) Robust. 


Table 6 Summary statistics of Solve Times for n = 100 [s]. 


Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

CPLEXGP 

28.85 

2172.25 

3600.07 

1441.31 

0 

1 

1 

GurobiGP 

21.90 

2053.05 

3600.09 

1435.75 

0 

1 

1 

GPLEXLP 

14.74 

3036.45 

3600.11 

1143.01 

0 

1 

1 

GurobiLP 

5.63 

2841.03 

3604.06 

1342.22 

0 

1 

1 

LiftedLP 

18.26 

529.57 

3600.04 

832.69 

6 

8 

11 

GPLEXSepLp 

5.00 

426.90 

3600.04 

854.99 

23 

25 

33 

GPLEXTowerLp 

6.77 

740.08 

3600.06 

1163.97 

0 

1 

2 

GPLEXTowerSepLp 

12.89 

1151.67 

3600.40 

1271.52 

0 

1 

1 

GurobiSepLp 

1.03 

593.35 

3600.05 

1064.61 

54 

55 

56 

GurobiTowerLp 

3.02 

1033.21 

3600.05 

1294.31 

1 

2 

2 

GurobiTowerSepLp 

6.31 

1685.98 

3600.07 

1411.79 

0 

1 

1 

GPLEXSepLazy 

5.51 

406.56 

3600.01 

752.93 

16 

17 

24 

GurobiSepLazy 

7.23 

954.15 

3600.09 

1245.66 

0 

1 

2 


(a) Robust. 


Table 7 Summary statistics of Solve Times for n = 200 [s]. 
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Algorithm 

min 

avg 

max 

std 

wins 

1 % win 

10 % win 

LiftedLP 

92.22 

1660.09 

3602.30 

1426.85 

1 

20 

20 

CPLEXSepLp 

27.42 

1381.03 

3600.08 

1417.33 

23 

42 

46 

GurobiSepLp 

4.11 

1429.40 

3600.12 

1432.61 

45 

65 

66 

CPLEXSepLazy 

31.46 

1390.95 

3600.05 

1422.92 

22 

31 

34 

GurobiSepLazy 

13.96 

2114.17 

3600.05 

1470.40 

9 

19 

19 


(a) Robust. 


Table 8 Summary statistics of Solve Times for n = 300 [s]. 


B.2 Summary Statistics for Solution Quality 

Tables 9—13 present summary statistics for the maximum violation of constraints (Ic) by the optimal solution returned by the 
solver. This value is calculated as 

max I I — + 


where x is the optimal solution. 


Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

5.87e-09 

8.31e-08 

1.20e-08 

CPLEXSepLp 

9.36e-ll 

5.66e-09 

5.50e-08 

8.56e-09 

CPLEXTowerLp 

O.OOe+00 

6.24e-09 

6.36e-08 

9.71e-09 

CPLEXTowerSepLp 

O.OOe+00 

4.16e-09 

3.59e-08 

7.12e-09 

GurobiSepLp 

3.84e-04 

5.98e-04 

8.28e-04 

8.31e-05 

GurobiTowerLp 

3.88e-04 

5.68e-04 

7.76e-04 

8.14e-05 

GurobiTowerSepLp 

4.02e-06 

3.92e-05 

1.54e-04 

3.13e-05 

CPLEXSepLazy 

4.68e-06 

6.40e-06 

8.82e-06 

8.99e-07 

GurobiSepLazy 

4.11e-06 

6.31e-06 

8.72e-06 

9.17e-07 


(a) Glassical. 



Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXSepLp 

O.OOe+00 

5.19e-10 

1.30e-08 

2.03e-09 

CPLEXTowerLp 

O.OOe+OO 

1.67e-ll 

1.09e-09 

1.23e-10 

CPLEXTowerSepLp 

O.OOe+OO 

6.25e-10 

5.18e-08 

5.21e-09 

GurobiSepLp 

4.19e-04 

6.47e-04 

8.46e-04 

8.87e-05 

GurobiTowerLp 

3.81e-04 

5.65e-04 

8.39e-04 

9.37e-05 

GurobiTowerSepLp 

4.82e-06 

5.36e-05 

2.50e-04 

4.29e-05 

CPLEXSepLazy 

O.OOe+OO 

6.37e-06 

9.33e-06 

1.35e-06 

GurobiSepLazy 

O.OOe+OO 

6.17e-06 

8.90e-06 

1.47e-06 


(b) Shortfall. 



Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

6.59e-09 

8.05e-08 

1.35e-08 

CPLEXSepLp 

1.26e-ll 

4.74e-09 

3.57e-08 

6.12e-09 

CPLEXTowerLp 

7.06e-ll 

5.09e-09 

8.23e-08 

l.Ole-08 

CPLEXTowerSepLp 

1 .02e-ll 

2.40e-09 

2.69e-08 

4.59e-09 

GurobiSepLp 

4.51e-04 

6.27e-04 

1.02e-03 

9.93e-05 

GurobiTowerLp 

1.92e-06 

3.07e-05 

1.19e-04 

2.11e-05 

GurobiTowerSepLp 

2.27e-06 

4.90e-05 

1.44e-04 

3.46e-05 

CPLEXSepLazy 

2.29e-06 

4.83e-06 

8.02e-06 

1.16e-06 

GurobiSepLazy 

2.29e-06 

4.71e-06 

7.50e-06 

1.05e-06 


(c) Robust. 


Table 9 Summary statistics of conic constraint violation for n = 20. 
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Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

7.78e-09 

9.01e-08 

1.57e-08 

CPLEXSepLp 

O.OOe+00 

9.56e-09 

7.86e-08 

1.41e-08 

CPLEXTowerLp 

O.OOe+00 

5.75e-09 

5.76e-08 

1.02e-08 

CPLEXTowerSepLp 

O.OOe+00 

1.67e-09 

1.95e-08 

3.52e-09 

GurobiSepLp 

4.91e-04 

7.52e-04 

1.03e-03 

l.lOe-04 

GurobiTowerLp 

4.77e-04 

7.10e-04 

1.04e-03 

1.18e-04 

GurobiTowerSepLp 

2.71e-06 

4.19e-05 

1.69e-04 

3.20e-05 

CPLEXSepLazy 

4.73e-06 

8.32e-06 

1.17e-05 

1.25e-06 

GurobiSepLazy 

4.93e-06 

8.23e-06 

1.19e-05 

1.34e-06 


(a) Classical. 



Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXSepLp 

O.OOe+00 

2.32e-09 

2.40e-08 

4.58e-09 

CPLEXTowerLp 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXTowerSepLp 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

GurobiSepLp 

5.46e-04 

7.91e-04 

1.15e-03 

1.12e-04 

GurobiTowerLp 

O.OOe+OO 

3.93e-05 

2.42e-04 

3.31e-05 

GurobiTowerSepLp 

O.OOe+OO 

5.30e-05 

3.60e-04 

5.19e-05 

CPLEXSepLazy 

O.OOe+OO 

8.38e-06 

l.lle-05 

1.38e-06 

GurobiSepLazy 

O.OOe+OO 

8.20e-06 

1.20e-05 

1.95e-06 


(b) Shortfall. 



Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

6.47e-09 

1.12e-07 

1.50e-08 

CPLEXSepLp 

2.17e-ll 

4.49e-09 

5.83e-08 

7.64e-09 

CPLEXTowerLp 

1.13e-ll 

3.68e-09 

4.03e-08 

6.82e-09 

CPLEXTowerSepLp 

O.OOe+OO 

9.52e-10 

1.42e-08 

1.74e-09 

GurobiSepLp 

5.57e-04 

8.22e-04 

1.23e-03 

1.30e-04 

GurobiTowerLp 

1.04e-06 

2.95e-05 

1.42e-04 

2.65e-05 

GurobiTowerSepLp 

8.51e-07 

4.09e-05 

1.71e-04 

3.84e-05 

CPLEXSepLazy 

2.70e-06 

6.75e-06 

l.OOe-05 

1.39e-06 

GurobiSepLazy 

2.21e-06 

6.31e-06 

9.71e-06 

1.46e-06 


(c) Robust. 


Table 10 Summary statistics of conic constraint violation for n = 30. 
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Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

4.47e-09 

1.23e-07 

1.68e-08 

CPLEXSepLp 

3.96e-ll 

9.40e-09 

8.67e-08 

1.56e-08 

CPLEXTowerLp 

O.OOe+00 

3.38e-09 

3.01e-08 

6.07e-09 

CPLEXTowerSepLp 

O.OOe+00 

1.02e-09 

4.12e-08 

4.36e-09 

GurobiSepLp 

6.61e-04 

9.23e-04 

1.31e-03 

1.33e-04 

GurobiTowerLp 

1.60e-06 

3.91e-05 

2.31e-04 

3.83e-05 

GurobiTowerSepLp 

3.59e-06 

6.26e-05 

2.20e-04 

5.33e-05 

CPLEXSepLazy 

6.73e-06 

9.94e-06 

1.32e-05 

1.32e-06 

GurobiSepLazy 

7.19e-06 

1.03e-05 

1.41e-05 

1.48e-06 


(a) Classical. 



Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXSepLp 

O.OOe+00 

4.15e-09 

4.05e-08 

6.54e-09 

CPLEXTowerLp 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXTowerSepLp 

O.OOe+OO 

1.75e-ll 

1.55e-09 

1.56e-10 

GurobiSepLp 

7.17e-04 

9.36e-04 

1.26e-03 

1.16e-04 

GurobiTowerLp 

2.82e-07 

5.86e-05 

3.51e-04 

6.24e-05 

GurobiTowerSepLp 

5.73e-06 

6.74e-05 

6.29e-04 

8.16e-05 

CPLEXSepLazy 

7.61e-06 

1.05e-05 

1.41e-05 

1.32e-06 

GurobiSepLazy 

O.OOe+OO 

l.OOe-05 

1.30e-05 

1.65e-06 


(b) Shortfall. 



Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

5.48e-09 

8.07e-08 

1.35e-08 

CPLEXSepLp 

6.25e-12 

3.72e-09 

3.74e-08 

6.68e-09 

CPLEXTowerLp 

O.OOe+OO 

2.25e-09 

3.65e-08 

4.38e-09 

CPLEXTowerSepLp 

O.OOe+OO 

1.54e-09 

2.68e-08 

3.31e-09 

GurobiSepLp 

7.19e-04 

9.86e-04 

1.35e-03 

1.57e-04 

GurobiTowerLp 

3.04e-06 

2.97e-05 

1.38e-04 

2.42e-05 

GurobiTowerSepLp 

2.77e-06 

4.00e-05 

2.34e-04 

3.66e-05 

CPLEXSepLazy 

3.38e-06 

8.47e-06 

1.25e-05 

1.90e-06 

GurobiSepLazy 

3.58e-06 

8.51e-06 

1.32e-05 

1.94e-06 


(c) Robust. 


Table 11 Summary statistics of conic constraint violation for n = 40. 
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Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

5.00e-09 

1.46e-07 

2.11e-08 

CPLEXSepLp 

1.27e-ll 

9.51e-09 

5.63e-08 

1.20e-08 

CPLEXTowerLp 

O.OOe+00 

3.34e-09 

5.17e-08 

6.74e-09 

CPLEXTowerSepLp 

O.OOe+00 

1.14e-09 

4.82e-08 

5.31e-09 

GurobiSepLp 

7.63e-04 

1.13e-03 

1.52e-03 

1.56e-04 

GurobiTowerLp 

O.OOe+00 

6.45e-05 

3.19e-04 

5.47e-05 

GurobiTowerSepLp 

O.OOe+00 

6.97e-05 

3.03e-04 

6.10e-05 

CPLEXSepLazy 

8.87e-06 

1.23e-05 

1.64e-05 

1.51e-06 

GurobiSepLazy 

7.96e-06 

1.21e-05 

1.62e-05 

1.43e-06 


(a) Classical. 



Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXSepLp 

O.OOe+00 

4.62e-09 

3.75e-08 

6.74e-09 

CPLEXTowerLp 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXTowerSepLp 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

GurobiSepLp 

7.21e-04 

l.lOe-03 

1.54e-03 

1.49e-04 

GurobiTowerLp 

O.OOe+OO 

8.81e-05 

3.75e-04 

9.06e-05 

GurobiTowerSepLp 

O.OOe+OO 

9.94e-05 

4.00e-04 

8.90e-05 

CPLEXSepLazy 

6.48e-06 

1.22e-05 

1.70e-05 

1.91e-06 

GurobiSepLazy 

O.OOe+OO 

1.22e-05 

1.66e-05 

2.05e-06 


(b) Shortfall. 



Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

6.56e-09 

2.55e-07 

2.76e-08 

CPLEXSepLp 

2.47e-ll 

5.58e-09 

6.47e-08 

1.26e-08 

CPLEXTowerLp 

O.OOe+OO 

2.99e-09 

3.95e-08 

5.81e-09 

CPLEXTowerSepLp 

O.OOe+OO 

5.75e-10 

1.49e-08 

1.87e-09 

GurobiSepLp 

8.24e-04 

1.15e-03 

1.54e-03 

1.66e-04 

GurobiTowerLp 

2.00e-06 

3.71e-05 

2.38e-04 

4.06e-05 

GurobiTowerSepLp 

2.56e-06 

4.73e-05 

1.94e-04 

4.30e-05 

CPLEXSepLazy 

4.09e-06 

l.Ole-05 

1.48e-05 

2.07e-06 

GurobiSepLazy 

3.59e-06 

l.Ole-05 

1.65e-05 

2.17e-06 


(c) Robust. 


Table 12 Summary statistics of conic constraint violation for n = 50. 
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Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

7.16e-09 

1.57e-07 

2.34e-08 

CPLEXSepLp 

O.OOe+00 

1.14e-08 

1.32e-07 

2.02e-08 

CPLEXTowerLp 

O.OOe+00 

2.23e-09 

2.41e-08 

4.45e-09 

CPLEXTowerSepLp 

O.OOe+00 

3.57e-10 

2.38e-08 

2.41e-09 

GurobiSepLp 

O.OOe+00 

1.31e-03 

1.69e-03 

2.19e-04 

GurobiTowerLp 

O.OOe+00 

6.18e-05 

2.65e-04 

5.12e-05 

GurobiTowerSepLp 

O.OOe+00 

8.76e-05 

4.45e-04 

8.17e-05 

CPLEXSepLazy 

l.lle-05 

1.39e-05 

1.83e-05 

1.56e-06 

GurobiSepLazy 

8.65e-06 

1.41e-05 

1.90e-05 

1.89e-06 


(a) Classical. 



Algorithm 

min 

avg 

max 

std 

LiftcdLP 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

CPLEXSepLp 

O.OOe+00 

6.95e-09 

1.61e-07 

1.79e-08 

CPLEXTowerLp 

O.OOe+OO 

1.06e-ll 

1.06e-09 

1.06e-10 

CPLEXTowerSepLp 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

O.OOe+OO 

GurobiSepLp 

O.OOe+OO 

1.24e-03 

1.63e-03 

1.85e-04 

GurobiTowerLp 

O.OOe+OO 

1.14e-04 

5.25e-04 

9.93e-05 

GurobiTowerSepLp 

O.OOe+OO 

1.16e-04 

5.57e-04 

1.09e-04 

CPLEXSepLazy 

9.24e-06 

1.43e-05 

2.01e-05 

1.97e-06 

GurobiSepLazy 

1.06e-05 

1.43e-05 

2.19e-05 

2.03e-06 


(b) Shortfall. 



Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

6.00e-09 

8.58e-08 

1.42e-08 

CPLEXSepLp 

2.80e-ll 

7.93e-09 

1.14e-07 

1.46e-08 

CPLEXTowerLp 

O.OOe+OO 

2.10e-09 

4.10e-08 

4.76e-09 

CPLEXTowerSepLp 

O.OOe+OO 

5.02e-10 

1.48e-08 

1.83e-09 

GurobiSepLp 

9.63e-04 

1.31e-03 

1.56e-03 

1.27e-04 

GurobiTowerLp 

2.06e-06 

3.58e-05 

1.27e-04 

2.96e-05 

GurobiTowerSepLp 

2.53e-06 

4.82e-05 

2.06e-04 

4.36e-05 

CPLEXSepLazy 

8.41e-06 

1.27e-05 

1.71e-05 

1.45e-06 

GurobiSepLazy 

5.04e-06 

1.21e-05 

1.77e-05 

1.83e-06 


(c) Robust. 


Table 13 Summary statistics of conic constraint violation for n = 60. 
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Algorithm 

min avg 

max 

std 

LiftcdLP 

O.OOe+OO 4.18e-09 

1.13e-07 

1.40e-08 

CPLEXSepLp 

O.OOe+00 9.51e-09 

1.13e-07 

1.97e-08 

GurobiSepLp 

O.OOe+00 1.68e-03 

3.04e-03 

9.73e-04 

CPLEXSepLazy 

1.58e-05 2.12e-05 

2.59e-05 

1.97e-06 

GurobiSepLazy 

1.39e-05 2.12e-05 

(a) Classical. 

2.69e-05 

2.31e-06 

Algorithm 

min avg 

max 

std 

LiftedLP 

O.OOe+00 O.OOe+00 

O.OOe+00 

O.OOe+00 

CPLEXSepLp 

O.OOe+00 9.92e-09 

1.21e-07 

2.03e-08 

GurobiSepLp 

O.OOe+00 1.39e-03 

2.29e-03 

8.42e-04 

CPLEXSepLazy 

1.41e-05 2.14e-05 

2.98e-05 

2.61e-06 

GurobiSepLazy 

O.OOe+00 2.19e-05 

(b) Shortfall. 

2.93e-05 

3.30e-06 

Algorithm 

min avg 

max 

std 

CPLEXCP 

O.OOe+00 6.93e-09 

1.78e-07 

2.69e-08 

GurobiCP 

O.OOe+00 2.55e-08 

1.18e-06 

1.30e-07 

CPLEXLP 

O.OOe+00 4.17e-09 

3.42e-08 

6.27e-09 

GurobiLP 

O.OOe+00 6.43e-05 

9.99e-05 

3.59e-05 

LiftedLP 

O.OOe+00 8.18e-09 

l.Ole-07 

1.88e-08 

GPLEXSepLp 

O.OOe+00 1.57e-08 

1.61e-07 

3.26e-08 

GPLEXTowerLp 

O.OOe+00 1.20e-09 

3.95e-08 

4.32e-09 

CPLEXTowerSepLp O.OOe+00 1.15e-10 

7.55e-09 

7.60e-10 

GurobiSepLp 

1.51e-03 1.86e-03 

2.35e-03 

1.94e-04 

GurobiTowerLp 

2.34e-06 5.25e-05 

2.63e-04 

4.32e-05 

GurobiTowerSepLp 

2.60e-06 6.64e-05 

4.05e-04 

6.14e-05 

CPLEXSepLazy 

1.43e-05 2.04e-05 

2.77e-05 

2.52e-06 

GurobiSepLazy 

8.77e-06 1.93e-05 

(c) Robust. 

2.44e-05 

2.37e-06 


Table 14 Summary statistics of conic constraint violation for n = 100 [s]. 


Algorithm 

min 

avg 

max 

std 

CPLEXCP 

O.OOe+OO 

1.73e-09 

8.96e-08 

9.49e-09 

GurobiCP 

O.OOe+00 

2.69e-08 

7.83e-07 

1.07e-07 

CPLEXLP 

O.OOe+OO 

2.04e-09 

5.48e-08 

7.18e-09 

GurobiLP 

O.OOe+OO 

2.61e-05 

9.86e-05 

3.97e-05 

LiftedLP 

O.OOe+OO 

6.70e-09 

1.66e-07 

2.14e-08 

CPLEXSepLp 

O.OOe+OO 

2.19e-07 

7.79e-07 

1.74e-07 

GPLEXTowerLp 

O.OOe+OO 

2.92e-ll 

1.14e-09 

1.61e-10 

CPLEXTowerSepLp 

O.OOe+OO 

4.47e-10 

1.28e-08 

2.09e-09 

GurobiSepLp 

O.OOe+OO 

3.40e-03 

4.28e-03 

9.77e-04 

GurobiTowerLp 

O.OOe+OO 

6.96e-05 

2.94e-04 

6.28e-05 

GurobiTowerSepLp 

O.OOe+OO 

7.14e-05 

2.58e-04 

6.26e-05 

CPLEXSepLazy 

2.34e-05 

3.84e-05 

4.78e-05 

3.89e-06 

GurobiSepLazy 

3.41e-08 

3.80e-05 

4.50e-05 

5.21e-06 


(a) Robust. 


Table 15 Summary statistics of conic constraint violation for n = 200 [s]. 



42 


Vielma et al. 


Algorithm 

min 

avg 

max 

std 

LiftedLP 

O.OOe+OO 

4.61e-09 

9.94e-08 

1.35e-08 

CPLEXSepLp 

O.OOe+00 

2.97e-07 

9.07e-07 

2.48e-07 

GurobiSepLp 

O.OOe+00 

4.09e-03 

6.35e-03 

2.39e-03 

CPLEXSepLazy 

4.47e-05 

5.79e-05 

6.91e-05 

4.48e-06 

GurobiSepLazy 

3.90e-05 

5.60e-05 

6.81e-05 

5.63e-06 


(a) 

Robust. 




Table 16 Summary statistics of conic constraint violation for n = 300 [s]. 


B.3 Additional Graphs 

Figure 6 compares the performance of the three dynamic lifted polyhedral relaxations in their nonlinear reformulation version 
(CPLEXSepLP, GurobiSepLP, CPLEXTowerLP, GurobiTowerLP, CPLEXTowerSepLP, GurobiTowerSepLP). We also include 
as a reference the NLP-based algorithms CPLEXCP and GurobiCP. 

LiftedLP Our final set of charts compare the branch- and cut-based LiftedLP algorithms (LiftedLP, CPLEXSepLazy and 
GurobiSepLazy) with the separable dynamic lifted polyhedral relaxation in its nonlinear reformulation version (CPLEXSepLP 
and GurobiSepLP). To minimize the complexity of the graphics we divide the comparison into two parts. In Figure 7 we compare 
the branch-based algorithm with the separable reformulations and in Figure 8 we compare the cut-based algorithms with the 
separable reformulations. 

From Figure 7 we see that the separable reformulations provide an advantage over the branch-based LiftedLP algorithm for 
all instances. However, this advantage becomes smaller as the problems sizes increase and the LiftedLP algorithm can provide 
an advantage in some instances (e.g Table 7 shows the algorithms is the fastest in 10% of the robust instances for n = 200). 
Figure 8 shows a similar behavior for the cut-based algorithms. 
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Instance Size 


I SepLP I TowerLP | TowerSepLP Cl CP 

(a) Classical-CPLEX. 



20 30 40 50 60 

Instance Size 

I SepLP I TowerLP S TowerSepLP C CP 

(c) Shortfall-CPLEX. 



20 30 40 50 60 100 200 

Instance Size 

I SepLP I TowerLP | TowerSepLP C CP 

(e) Robust-CPLEX. 



Instance Size 


I SepLP I TowerLP | TowerSepLP C CP 

(b) Classical-Gurobi. 



20 30 40 50 60 

Instance Size 

I SepLP I TowerLP | TowerSepLP C CP 

(d) Shortfall-Gurobi. 



20 30 40 50 60 100 200 

Instance Size 

I SepLP I TowerLP | TowerSepLP Q CP 

(f) Robust-Gurobi. 


Fig. 6 Solution times for dynamic lifted polyhedral relaxations solved by standard LP-based algorithms [s]. 
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Instance Size 

■ LiftedLP ■ CPLEXSepLP ■ GurobiSepLP 

(a) Classical. 



20 30 40 50 60 

Instance Size 

■ LiftedLP ■ CPLEXSepLP ■ GurobiSepLP 

(b) Shortfall. 



20 30 40 50 60 100 200 300 

Instance Size 

■ LiftedLP ■ CPLEXSepLP ■ GurobiSepLP 

(c) Robust. 



100 


Fig. 7 Solution times for the branch-based LiftedLP algorithm and best LP-based (separable re-formulation) algorithms [s]. 
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■ CPLEXSepLazy 



30 40 50 60 100 

Instance Size 

GurobiSepLazy | CPLEXSepLP O GurobiSepLP 
(a) Classical. 


20 30 40 50 60 100 

Instance Size 

CPLEXSepLazy | GurobiSepLazy | CPLEXSepLP O GurobiSepLP 

(b) Shortfall. 



20 30 40 50 60 100 200 300 

Instance Size 

■ CPLEXSepLazy ■ GurobiSepLazy M CPLEXSepLP □ GurobiSepLP 

(c) Robust. 


Fig. 8 Solution times for the cut-based LiftedLP algorithms and best LP-based (separable re-formulation) algorithms [s]. 































































